-- Logs begin at Thu 2022-09-15 18:35:39 UTC, end at Thu 2022-09-15 19:45:23 UTC. -- Sep 15 19:17:52.635227 dv-cinder-849846-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 19:17:52 2022] *** Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: nodename: dv-cinder-849846-10-iscsi Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: machine: x86_64 Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: clock source: unix Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: pcre jit disabled Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: detected number of CPU cores: 4 Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: current working directory: / Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: detected binary path: /usr/bin/uwsgi-core Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: your processes number limit is 47680 Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: your memory page size is 4096 bytes Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: detected max file descriptor number: 2048 Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: lock engine: pthread robust mutexes Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: thunder lock: enabled Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 19:17:52.647276 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 19:17:52.685454 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: Python main interpreter initialized at 0x5606affbf9c0 Sep 15 19:17:52.685454 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: python threads support enabled Sep 15 19:17:52.685454 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: your server socket listen backlog is limited to 100 connections Sep 15 19:17:52.685454 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: your mercy for graceful operations on workers is 90 seconds Sep 15 19:17:52.685787 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 19:17:52.685864 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: *** Operational MODE: preforking *** Sep 15 19:17:52.686112 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: *** uWSGI is running in multiple interpreter mode *** Sep 15 19:17:52.686112 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: spawned uWSGI master process (pid: 105816) Sep 15 19:17:52.686305 dv-cinder-849846-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 19:17:52.686925 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: spawned uWSGI worker 1 (pid: 105817, cores: 1) Sep 15 19:17:52.690002 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: spawned uWSGI worker 2 (pid: 105818, cores: 1) Sep 15 19:17:52.690002 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 19:17:53.348503 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 19:17:53.361516 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 19:17:54.434836 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 19:17:54.434836 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: from cryptography.utils import int_from_bytes Sep 15 19:17:54.435466 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 19:17:54.435466 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: from cryptography.utils import int_from_bytes Sep 15 19:17:54.441228 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 19:17:54.441228 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: from cryptography.utils import int_from_bytes Sep 15 19:17:54.441667 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 19:17:54.441667 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: from cryptography.utils import int_from_bytes Sep 15 19:17:56.924007 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 19:17:56.924549 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 19:17:56.924801 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 19:17:56.925166 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 19:17:56.925423 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 19:17:56.925816 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.925922 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 19:17:56.926270 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 19:17:56.926339 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.926452 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.926612 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 19:17:56.926783 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.926979 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 19:17:56.927530 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.927623 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 19:17:56.927738 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.927839 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.927927 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.928006 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.928083 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.928272 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.928417 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.928596 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.928693 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.928925 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.929032 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.929238 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.929339 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-10-iscsi {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.930075 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.930185 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.930391 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.930498 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.930702 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.930795 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.930969 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.931063 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.931291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.931388 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.931625 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-10-iscsi {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.931786 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.931956 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.932051 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.932274 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.932468 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.932587 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.932897 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.933206 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.933307 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.933519 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.933687 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.934039 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.934156 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.934246 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.934318 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.934573 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.934692 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.934895 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.935007 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.935217 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.935338 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.935519 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.935625 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.935870 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.935966 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.936183 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.936290 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.936505 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.936610 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-10-iscsi {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.936821 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.936920 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.937147 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.937242 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.937460 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.937563 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.937859 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-10-iscsi {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.937963 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.938179 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.938287 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.938509 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.938621 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.938794 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.938892 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.939115 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.939220 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.939427 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.939526 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.939781 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.939878 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.940110 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.940222 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.940444 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.940541 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.940756 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.940869 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.941053 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.941161 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.941365 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.941461 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.941677 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.941782 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.942008 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.942104 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.942297 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.942403 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.942608 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.942714 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.942921 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.943015 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.943244 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.943347 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.943554 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.943748 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.943990 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.944154 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.944295 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.944440 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.944591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.944738 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.944738 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.945032 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.945240 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.945911 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.946064 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.946214 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.946376 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.946522 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.946522 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.946809 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.946964 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.947105 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.947243 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.947389 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.947389 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.947691 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.947856 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.947997 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.948152 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.948299 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.948438 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.948604 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.948827 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.948981 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.949119 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.949258 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.949404 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.949553 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.949692 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.949860 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.950085 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.950229 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.950229 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.950531 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.950531 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.950840 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.951057 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.951263 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.951415 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.951564 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.951733 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.951889 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.952030 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.952268 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.952448 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.952630 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.952802 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.952966 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.953117 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.953257 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.953424 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.953590 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.953759 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.953924 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.954150 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.954302 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.954491 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.954643 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.954783 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.954923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.955061 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.955207 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.955354 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.955500 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.955743 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.955892 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.956031 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.956183 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.956332 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.956482 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.956628 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.956766 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.956904 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.957042 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.957189 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.957329 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.957467 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.957611 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.957749 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.957901 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.958040 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.958199 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.958348 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.958486 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.958632 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.958869 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.959021 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.959159 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.959305 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.959453 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.959592 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.959814 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.959978 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.960202 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.960369 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.960510 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.960648 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.960892 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.961158 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.961306 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.961453 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.961594 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.961732 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.961934 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.962088 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.962306 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.962453 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.962604 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.963183 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.963349 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.963491 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.963640 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.963821 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.963970 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.964211 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.964371 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.964549 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.964696 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.964834 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.964972 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.965508 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.968723 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.968828 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.968930 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.969013 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.969103 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.969193 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.969280 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.969369 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.969456 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.969536 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.969613 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.969705 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.969785 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.969872 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.969957 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.970043 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.970121 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.970363 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.970460 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.970542 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.970627 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.970706 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.970792 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.970881 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.970964 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.971042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.971120 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.971223 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.971301 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.971381 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.971460 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.971539 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.971633 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.971736 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.971826 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.971912 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.971912 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.972060 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.972139 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.972241 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.972329 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.972409 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.972409 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.972549 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.972633 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.972712 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.972801 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.972881 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.972968 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.973047 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.973124 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:17:56.973213 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.973299 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.973378 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.973463 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.973542 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.973625 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.973711 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.973791 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.973869 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.973945 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.974023 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.974023 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.974171 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.974266 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.974346 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.974423 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.974506 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.974606 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.974687 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.974764 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.974840 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.974917 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.974994 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.975096 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.975186 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.975266 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.975344 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.975487 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.975601 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.975823 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.975945 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.976146 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.976235 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.976492 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.976595 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.976814 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.976903 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.977137 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.977225 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.977452 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.977539 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.977773 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.977861 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.978106 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.978194 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.978437 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.978530 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.978756 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.978843 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.979072 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.979158 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.979387 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.979473 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.979722 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.979876 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.980074 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.980221 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.980448 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.980662 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.980804 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.980943 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.981079 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.981224 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.981323 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.981458 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.981595 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.981731 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.981904 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.982039 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.982215 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.982362 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.982527 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.982668 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.982842 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.982992 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.983138 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.983283 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.983477 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.983623 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.983846 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.983982 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.984129 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.984274 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.984432 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.984578 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.984745 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.984882 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.985066 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.985163 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.985381 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.985475 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.985694 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.985793 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.986006 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.986095 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.986314 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.986410 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.986623 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.986710 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.986929 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.987025 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.987238 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.987324 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.987543 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.987630 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.987876 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.987973 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.988184 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.988279 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.988489 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.988591 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.988801 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.988895 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.989110 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.989198 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.989420 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.989514 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.989735 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.989824 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.990043 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.990136 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.990347 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.990459 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.990662 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.990761 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.990970 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.991058 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.991273 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.991368 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.991589 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.991698 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.991925 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.992013 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.992749 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.992870 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.993061 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.993161 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.993367 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.993457 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.993674 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.993765 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.993989 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.994077 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.994297 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.994386 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.994603 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.994692 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.994911 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.995000 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.995217 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.995314 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.995531 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.995621 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.995866 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.995955 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.996175 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.996282 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.996490 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.996580 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.996803 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.996900 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.997119 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.997217 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.997428 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.997523 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.997737 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.997828 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.998058 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.998160 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.998364 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.998453 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.998675 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.998764 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.998981 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.999079 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.999285 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.999374 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.999589 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.999720 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:56.999923 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.000013 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.000227 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.000317 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.000558 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.000649 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.000845 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.000944 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.001148 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.001238 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.001452 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.001566 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.001755 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.001845 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.002068 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.002166 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.002368 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.002463 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.002670 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.002761 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.002971 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.003067 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.003291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.003389 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.003600 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.003712 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.003936 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.004025 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.004242 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.004341 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.004548 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.004638 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.004890 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.004979 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.005198 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.005296 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.005512 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.005601 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.005823 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.005913 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.006135 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.006233 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.006447 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.006543 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.006756 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.006851 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.007076 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.007166 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.007384 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.007472 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.007746 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.008325 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.008569 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.008667 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.008880 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.008969 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.009191 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.009286 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.009506 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.009595 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.009807 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.009895 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.010122 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.010224 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.010445 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.010560 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.010758 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.010879 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.011083 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.011183 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.011388 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.011486 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.011719 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.011831 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.012036 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.012134 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.012346 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.012435 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.012656 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.012795 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.012967 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.013064 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.013276 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.013373 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.013594 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.013683 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.013904 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.014004 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.014218 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.014312 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.014525 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.014613 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.014834 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.014930 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.015144 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.015230 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.015454 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.015540 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.015780 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.015871 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.016101 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.016209 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.016424 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.016525 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.016740 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.016831 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.017047 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.017143 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.017353 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.017442 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.017669 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.017759 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.017977 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.018066 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.018287 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.018378 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.018597 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.018687 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.018902 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.018992 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.019206 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.019360 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.019503 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.019637 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.019838 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.019975 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.020118 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.020263 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.020431 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.020573 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.020736 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.020876 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.021043 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.021194 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.021331 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.021465 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.021629 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.021777 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.021934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.022094 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.022229 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.022365 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.022549 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.022692 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.022859 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.023000 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.023167 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.023875 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.024026 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.024161 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.024308 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.024468 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.024615 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.024750 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.024929 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.025071 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.025242 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.025392 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.025550 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.025691 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.025855 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.026003 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.026147 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.026289 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.026471 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.026613 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.026785 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.026926 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.027075 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.027210 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.027383 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.027534 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.027699 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.027852 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.028047 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.028190 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.028360 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.028513 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.028670 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.028819 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.028977 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.029124 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.029299 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.029442 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.029609 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.029758 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.029917 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.030058 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.030230 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.030370 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.030543 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.030695 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.030838 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.030973 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.031150 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.031291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.031468 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.031609 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.031800 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.031940 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.032113 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.032262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.032418 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.032554 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.032714 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.032864 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.033026 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.033174 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.033318 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.033461 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.033633 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.033906 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.034048 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.034240 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.034390 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.034547 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.034696 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.034855 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.034997 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.035201 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.035435 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.035591 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.035800 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.035945 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.036124 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.036266 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.036449 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.036593 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.036790 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.036937 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.037082 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.037226 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.037391 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.037546 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.037690 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.037825 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.037994 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.038137 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.038298 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.038449 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.038585 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.038730 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.038903 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.039701 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.039854 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.040009 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.040153 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.040295 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.040437 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.040585 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.040734 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.040885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.041027 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.041181 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.041323 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.041464 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.041605 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.041754 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.041897 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.042038 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.042181 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.042329 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.042485 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.042628 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.042778 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.042919 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.043070 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.043211 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.043362 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.043510 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.043672 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.043830 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.043974 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.044122 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.044274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.044416 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.044566 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.044715 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.044858 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.045009 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.045160 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.045308 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.045496 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.045645 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.045787 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.045936 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.046376 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.046527 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.046669 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.046810 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.046974 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.047143 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.047286 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.047428 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.047576 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.047776 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.047922 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.048075 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.048226 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.048368 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.048517 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.048659 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.048809 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.048951 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.049103 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.049244 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.049385 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.049528 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.049678 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.049820 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.049962 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.050103 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.050244 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.050418 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.050578 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.050721 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.050862 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.051035 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.051185 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.051334 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.051486 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.051629 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.051800 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.051974 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.052126 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.052280 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.052421 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.052590 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.052748 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.052890 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.053042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.053192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.053335 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.053476 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.053617 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.053759 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.053900 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.054049 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.054191 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.054359 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.054536 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.054713 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.054855 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.055016 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.055158 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.055300 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.055446 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.055592 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.055802 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.055961 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.056113 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.056256 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.056404 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.056546 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.056695 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.056853 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.057002 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.057145 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.057286 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.057427 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.057577 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.057726 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.057875 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.058025 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.058173 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.058316 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.058465 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.058608 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.058760 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.058901 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.059051 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.059193 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.059348 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.059491 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.059632 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.059798 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.059956 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.060108 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.060251 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.060392 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.060533 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.060684 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.060832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.060982 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.061134 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.061276 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.061424 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.061566 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.061707 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.061861 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.062003 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.062145 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.062286 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.062428 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.062578 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.062732 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.062875 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.063016 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.063158 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.063308 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.063493 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.063637 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.063812 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.063954 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.064094 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.064244 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.064393 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.064554 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.064697 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.064837 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.064983 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.065125 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.065276 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.065423 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.065570 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.065719 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.065863 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.066012 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.066161 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.066321 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.066470 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.066613 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.066754 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.066903 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.067052 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.067201 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.067343 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.067483 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.067632 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.067833 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.067976 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.068117 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.068276 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.068419 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.068560 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.068714 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.068856 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.069024 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.069174 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.069322 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.069466 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.069615 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.069757 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.069905 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.070053 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.070723 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.070948 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.071093 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.071235 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.071376 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.071517 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.071706 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.071869 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.072013 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.072154 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.072303 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.072445 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.072587 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.072747 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.072896 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.073038 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.073179 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.073320 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.073461 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.073611 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.073754 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.073895 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.074048 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.074190 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.074340 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.074500 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.074642 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.074785 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.074926 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.075067 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.075216 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.075366 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.075508 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.075694 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.075855 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.076042 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.076206 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.076356 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.076509 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.076651 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.076826 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.076976 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.077139 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.077282 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.077431 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.077581 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.077732 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.077946 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.078106 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.078254 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.078403 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.078556 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.078698 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.078848 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.078991 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.079138 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.079328 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.079480 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.079630 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.079818 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.079968 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.080110 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.080251 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.080392 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.080544 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.080694 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.080845 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.080987 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.081129 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.081378 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.081537 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.081688 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.081829 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.081998 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.082148 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.082297 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.082469 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.082621 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.082762 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.082903 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.083043 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.083185 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.083335 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.083513 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.083726 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.083876 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.084017 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.084160 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.084313 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.084466 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.084614 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.084765 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.084942 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.085101 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.085244 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.085393 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.085534 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.085748 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.086515 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.086670 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.086814 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.086984 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.087146 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.087291 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.087432 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.087575 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.087750 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.087908 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.088052 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.088226 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.088377 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.088542 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.088691 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.088918 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.089074 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.089216 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.089358 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.089508 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.089660 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.089814 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.089965 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.090107 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.090249 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.090398 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.090553 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.090697 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.090837 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.090989 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.091131 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.091279 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.091429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.091610 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.091796 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.091962 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.092122 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.092266 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.092416 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.092598 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.092749 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.092892 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.093044 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.093186 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.093336 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.093479 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.093622 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.093791 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.093941 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.094101 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.094244 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.094386 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.094528 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.094672 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.094813 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.094973 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.095115 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.095264 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.095407 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.095549 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.095725 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.095889 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.096033 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.096189 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.096339 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.096488 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.096642 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.096807 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.096951 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.097101 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.097251 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.097395 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.097545 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.097697 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.097841 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.097982 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.098124 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.098273 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.098424 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.098582 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.098735 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.098878 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.099020 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.099169 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.099345 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.099496 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.099700 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.099854 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.099997 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.100140 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.100293 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.100436 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.100578 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.100735 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.100887 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.101038 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.101181 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.101353 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.101554 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.101699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.101841 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.101993 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.102136 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.102306 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.102463 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.102628 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.102788 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.102939 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.103083 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.103232 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.103381 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.103533 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.103712 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.103874 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.104045 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.104195 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.104368 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.104518 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.104687 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.104831 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.104981 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.105134 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.105299 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.105450 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.105600 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.105742 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.105891 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.106035 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.106185 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.106328 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.106478 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.106644 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.106792 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.106934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.107076 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.107219 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.107374 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.107525 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.107784 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.107935 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.108087 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.108239 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.108382 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.108524 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.108676 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.108819 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.108961 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.109117 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.109260 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.109404 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.109553 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.109702 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.109853 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.110008 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.110152 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.110293 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.110447 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.110590 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.110733 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.110883 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.111027 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.111169 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.111311 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.111453 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.111612 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.111844 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.112089 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.112332 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.112572 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.112810 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.113055 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.113207 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.113359 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.113503 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.113503 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.113503 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.113932 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.114075 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.114383 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.114538 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.114703 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.114852 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.115019 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.115162 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.115327 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.115478 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.115723 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.115892 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.116036 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.116178 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.116356 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.116512 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.116657 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.116815 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.116979 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.117161 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.117307 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.117449 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.117591 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.117812 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.117957 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.118100 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.118249 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.118399 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.118550 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.118694 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.118868 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.119030 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.119180 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.119324 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.119481 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.119624 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.119807 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.119959 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.120116 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.120259 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.120461 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.120618 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.120771 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.120915 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.121065 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.121215 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.121358 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.121499 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.121678 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.121829 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.121984 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.122127 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.122298 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.122449 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.122601 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.122743 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.122902 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.123047 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.123212 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.123364 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.123507 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.123698 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.123863 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.124014 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.124176 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.124326 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.124477 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.124638 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.124795 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.124945 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.125089 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.125232 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.125375 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.125526 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.125668 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.125811 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.125983 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.126135 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.126302 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.126474 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.126618 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.126820 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.126977 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.127130 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.127281 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.127456 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.127619 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.127800 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.128079 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.128231 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.128382 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.128543 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.128719 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.128870 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.129043 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.129191 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.129344 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.129495 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.129644 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.129786 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.129957 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.130099 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.130250 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.130393 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.130546 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.130687 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.130830 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.130971 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.131121 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.131264 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.131414 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.131557 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.131763 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.131922 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.132065 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.132207 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.132396 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.132556 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.133234 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.133393 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.133538 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.133703 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.133853 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.134031 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.134357 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.134515 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.134669 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.134813 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.134964 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.135107 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.135279 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.135438 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.135583 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.135759 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.135904 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.136061 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.136213 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.136371 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.136515 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.136658 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.136799 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.136941 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.137102 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.137252 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.137406 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.137550 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.137693 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.137843 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.137999 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.138141 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.138283 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.138433 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.138581 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.138732 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.138894 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.139048 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.139199 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.139348 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.139491 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.139641 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.139825 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.139978 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.140120 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.140267 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.140410 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.140560 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.140703 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.140845 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.140998 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.141149 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.141298 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.141453 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.141603 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.141745 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.141888 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.142030 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.142187 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.142339 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.142488 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.142630 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.142780 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.142939 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.143098 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.143241 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.143383 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.143525 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.143696 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.143846 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.144000 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.144150 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.144293 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.144442 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.144584 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.144736 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.144886 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.145041 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.145191 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.145334 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.145483 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.145632 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.145788 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.145931 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.146081 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.146230 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.146371 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.146589 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.146744 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.146886 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.147072 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.147233 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.147384 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.147539 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.147749 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.147903 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.148072 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.148233 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.148988 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.149231 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.149384 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.149576 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.149725 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.149875 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.150024 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.150198 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.150350 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.150493 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.150634 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.150811 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.150970 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.151128 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.151271 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.151423 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.151565 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.151736 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.151897 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.152047 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.152206 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.152349 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.152491 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.152633 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.152792 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.152944 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.153093 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.153243 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.153400 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.153551 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.153694 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.153836 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.153978 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.154120 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.154262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.154413 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.154556 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.154698 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.154839 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.155018 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.155179 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.155331 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.155475 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.155623 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.155835 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.155980 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.156130 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.156274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.156415 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.156566 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.156709 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.156851 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.157001 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.157154 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.157297 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.157445 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.157599 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.157745 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.157896 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.158038 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.158182 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.158354 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.158506 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.158658 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.158808 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.159084 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.159313 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.159476 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.159620 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.159804 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.159951 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.160093 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.160274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.160432 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.160583 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.160895 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.161045 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.161219 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.161371 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.161535 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.161695 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.161867 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.162028 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.162178 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.162321 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.162495 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.162655 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.162835 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.162992 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.163163 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.163331 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.163474 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.163627 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.163822 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.164010 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.164156 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.164298 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.164449 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.164601 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.164753 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.164896 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.165046 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.165198 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.165357 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.165500 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.165651 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.165793 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.165942 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.166085 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.166236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.166379 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.166520 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.166662 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.166813 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.166955 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.167121 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.167264 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.167406 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.167548 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.167719 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.167876 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.168037 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.168181 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.168329 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.168471 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.168614 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.168773 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.168916 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.169069 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.169212 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.169353 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.169494 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.169653 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.169802 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.169953 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.170103 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.170261 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.170404 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.170563 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.170706 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.170849 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.171007 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.171417 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.171574 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.171737 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.171884 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.172026 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.172177 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.172563 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.172720 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.172864 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.173006 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.173334 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.173933 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.174121 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.174282 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.174427 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.174577 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.174731 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.174874 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.175016 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.175171 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.175314 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.175457 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.175599 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.175783 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.175949 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.176092 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.176241 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.176392 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.176549 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.176691 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.176909 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.177055 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.177196 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.177338 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.177486 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.177629 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.177784 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.177942 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.178093 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.178236 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.178379 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.178520 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.178686 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.178838 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.178987 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.179137 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.179279 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.179430 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.179613 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.179764 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.179865 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.179953 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.180035 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.180134 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.180226 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.180308 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.180388 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.180468 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.180548 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.180638 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.180726 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.180808 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.180887 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.181106 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.181214 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.181439 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.181529 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.181755 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.181858 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.182065 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.182163 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.182372 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.182469 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.182685 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.182774 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.182996 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.183094 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.183311 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.183399 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.183627 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.183735 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.183965 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.184087 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.184279 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.184368 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.184599 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.184687 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.184959 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.185055 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.185242 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.185331 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.185558 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.185645 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.185888 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.185978 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.186204 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.186299 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.186525 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.186627 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.186833 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.186924 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.187075 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 19:17:57.187171 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.187501 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.187848 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.188167 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.188477 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:17:57.188723 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 19:17:57.339183 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO dbcounter [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Registered counter for database nova_api Sep 15 19:17:57.340655 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO dbcounter [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Registered counter for database nova_api Sep 15 19:17:57.360149 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_db.sqlalchemy.engines [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105817) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:17:57.361645 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG oslo_db.sqlalchemy.engines [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:17:57.366753 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writer thread running {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:17:57.368221 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG dbcounter [-] [105818] Writer thread running {{(pid=105818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:17:57.423929 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.context [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25eb2376-64df-4345-a21d-3047a261cd80(cell1) {{(pid=105817) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 19:17:57.425557 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.context [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25eb2376-64df-4345-a21d-3047a261cd80(cell1) {{(pid=105818) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 19:17:57.427936 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:17:57.428412 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:17:57.429402 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG oslo_concurrency.lockutils [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:17:57.430411 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG oslo_concurrency.lockutils [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:17:57.430522 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:17:57.431234 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:17:57.431705 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:17:57.432008 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG oslo_concurrency.lockutils [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:17:57.432767 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG oslo_concurrency.lockutils [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:17:57.433217 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG oslo_concurrency.lockutils [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:17:57.433673 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:17:57.435217 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG oslo_concurrency.lockutils [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:17:57.435633 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO dbcounter [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Registered counter for database nova_cell0 Sep 15 19:17:57.437215 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO dbcounter [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Registered counter for database nova_cell0 Sep 15 19:17:57.439838 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO dbcounter [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Registered counter for database nova_cell1 Sep 15 19:17:57.441177 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO dbcounter [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Registered counter for database nova_cell1 Sep 15 19:17:57.447740 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_db.sqlalchemy.engines [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105817) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:17:57.449394 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_db.sqlalchemy.engines [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105817) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:17:57.451000 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG oslo_db.sqlalchemy.engines [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:17:57.452804 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG oslo_db.sqlalchemy.engines [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:17:57.454610 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writer thread running {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:17:57.458969 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG dbcounter [-] [105818] Writer thread running {{(pid=105818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:17:57.460470 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG dbcounter [-] [105818] Writer thread running {{(pid=105818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:17:57.591629 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writer thread running {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:17:57.601482 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO dbcounter [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Registered counter for database nova_cell0 Sep 15 19:17:57.604928 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO dbcounter [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Registered counter for database nova_cell0 Sep 15 19:17:57.608519 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_db.sqlalchemy.engines [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105817) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:17:57.613248 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writer thread running {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:17:57.613914 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG oslo_db.sqlalchemy.engines [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:17:57.618869 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG dbcounter [-] [105818] Writer thread running {{(pid=105818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:17:58.019988 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: WARNING keystonemiddleware.auth_token [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 19:17:58.025261 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: WARNING keystonemiddleware.auth_token [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 19:17:58.027326 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: WARNING keystonemiddleware.auth_token [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 19:17:58.032582 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: WARNING keystonemiddleware.auth_token [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 19:17:58.376105 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: WARNING keystonemiddleware.auth_token [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 19:17:58.377625 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: WARNING keystonemiddleware.auth_token [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 19:17:58.382062 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: WARNING keystonemiddleware.auth_token [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 19:17:58.384344 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: WARNING keystonemiddleware.auth_token [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 19:17:58.388028 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5606affbf9c0 pid: 105818 (default app) Sep 15 19:17:58.390308 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:17:58.390521 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5606affbf9c0 pid: 105817 (default app) Sep 15 19:17:58.391507 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-e00c21c6-441e-4d25-a9c2-b75bfc5b7294 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001940 Sep 15 19:17:58.391951 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Thu Sep 15 19:17:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:19:22.103099 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:22.104649 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Sep 15 19:19:22.105217 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:19:22 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:19:22.116513 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG dbcounter [-] [105818] Writing DB stats nova_api:SELECT=3 {{(pid=105818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:22.118557 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG dbcounter [-] [105818] Writing DB stats nova_cell1:SELECT=3 {{(pid=105818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:22.120009 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG dbcounter [-] [105818] Writing DB stats nova_cell0:SELECT=3 {{(pid=105818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:22.120882 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG dbcounter [-] [105818] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:23.006163 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-cda76ce2-f13e-4593-a7d9-0d4d7e6249cf admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:23.039231 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-cda76ce2-f13e-4593-a7d9-0d4d7e6249cf admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.927920 Sep 15 19:19:23.040180 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1292 bytes} [Thu Sep 15 19:19:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:19:25.660618 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:25.661666 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-c5140e76-5439-46c5-82fc-92389ff192e5 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 15 19:19:25.662179 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 2/4] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:19:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:19:26.123614 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-adbd9b86-6eed-4536-b0d8-8a269b170484 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "ram": 256, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "cirros256"}} {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:26.238969 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-adbd9b86-6eed-4536-b0d8-8a269b170484 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.570596 Sep 15 19:19:26.239540 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 3/5] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 15 19:19:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 19:19:26.464149 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-fca86cdd-6f18-40ce-bd7d-6bddeb8c7508 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:26.470624 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writing DB stats nova_api:SELECT=3 {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:26.471617 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writing DB stats nova_cell0:SELECT=3 {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:26.472348 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writing DB stats nova_cell1:SELECT=3 {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:26.473060 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:26.591765 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-fca86cdd-6f18-40ce-bd7d-6bddeb8c7508 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.342992 Sep 15 19:19:26.592360 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 3/6] 10.222.0.18 () {64 vars in 1336 bytes} [Thu Sep 15 19:19:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:19:29.200538 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-adbd9b86-6eed-4536-b0d8-8a269b170484 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:29.201614 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-adbd9b86-6eed-4536-b0d8-8a269b170484 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Sep 15 19:19:29.202019 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 4/7] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:19:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:19:29.870259 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-7212fd43-eb05-4cd8-9f12-12f238b66785 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1"}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:29.999224 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-7212fd43-eb05-4cd8-9f12-12f238b66785 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.790924 Sep 15 19:19:30.000207 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 4/8] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 15 19:19:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 19:19:30.019740 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-a16e5f61-724e-40f3-8f76-bdde4e1227f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:30.150494 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-a16e5f61-724e-40f3-8f76-bdde4e1227f7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141417 Sep 15 19:19:30.151156 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 5/9] 10.222.0.18 () {64 vars in 1336 bytes} [Thu Sep 15 19:19:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:19:32.735896 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-7212fd43-eb05-4cd8-9f12-12f238b66785 admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:32.736926 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-7212fd43-eb05-4cd8-9f12-12f238b66785 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 15 19:19:32.737325 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:19:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:19:33.152681 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-d74cb67e-1a33-4097-bf28-527319f6a306 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:33.226793 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-d74cb67e-1a33-4097-bf28-527319f6a306 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481937 Sep 15 19:19:33.227460 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 6/11] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 15 19:19:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 19:19:33.239958 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-9c428d85-d49f-4760-9a34-918e54488f78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:33.339416 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-9c428d85-d49f-4760-9a34-918e54488f78 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103244 Sep 15 19:19:33.340056 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 6/12] 10.222.0.18 () {64 vars in 1336 bytes} [Thu Sep 15 19:19:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:19:35.950120 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-d74cb67e-1a33-4097-bf28-527319f6a306 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:35.951958 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-d74cb67e-1a33-4097-bf28-527319f6a306 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002186 Sep 15 19:19:35.952533 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 7/13] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:19:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:19:36.376483 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-4c8c3dd6-9e3a-4293-8de6-0a2496e13bf1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:36.478712 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-4c8c3dd6-9e3a-4293-8de6-0a2496e13bf1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520086 Sep 15 19:19:36.479271 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 7/14] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 15 19:19:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 19:19:36.491674 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-652ecab9-6ae9-4950-b7fc-99e732d80dc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:36.673409 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-652ecab9-6ae9-4950-b7fc-99e732d80dc6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.185418 Sep 15 19:19:36.674345 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 8/15] 10.222.0.18 () {64 vars in 1336 bytes} [Thu Sep 15 19:19:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:19:39.294076 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-4c8c3dd6-9e3a-4293-8de6-0a2496e13bf1 admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:39.295164 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-4c8c3dd6-9e3a-4293-8de6-0a2496e13bf1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Sep 15 19:19:39.295563 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 8/16] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:19:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:19:39.719181 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-5e873699-a598-49c8-b1c8-46e1844fa7ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "disk": 20, "os-flavor-access:is_public": true}} {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:39.799293 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-5e873699-a598-49c8-b1c8-46e1844fa7ac admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496217 Sep 15 19:19:39.799982 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 9/17] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 15 19:19:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 19:19:39.812953 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-73c49ce6-d5af-43b9-a55b-f7fd91cb9a08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:39.902560 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-73c49ce6-d5af-43b9-a55b-f7fd91cb9a08 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093477 Sep 15 19:19:39.903074 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 9/18] 10.222.0.18 () {64 vars in 1336 bytes} [Thu Sep 15 19:19:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:19:42.796994 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-5e873699-a598-49c8-b1c8-46e1844fa7ac admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:42.798181 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-5e873699-a598-49c8-b1c8-46e1844fa7ac admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 Sep 15 19:19:42.798889 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 10/19] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:19:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:19:43.221621 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-33e3e163-b3b3-4399-a0e1-20f407807d4a admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:43.254177 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-33e3e163-b3b3-4399-a0e1-20f407807d4a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.448196 Sep 15 19:19:43.254887 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 10/20] 10.222.0.18 () {60 vars in 1292 bytes} [Thu Sep 15 19:19:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:19:46.139913 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-5e873699-a598-49c8-b1c8-46e1844fa7ac admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:46.140935 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-5e873699-a598-49c8-b1c8-46e1844fa7ac admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 15 19:19:46.141340 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 11/21] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:19:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:19:46.542798 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-5f2add1c-860f-4622-90ed-16a3b5b4650f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:46.633356 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-5f2add1c-860f-4622-90ed-16a3b5b4650f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.485723 Sep 15 19:19:46.634018 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 11/22] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 15 19:19:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 19:19:46.646523 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-5c147c24-b4c8-4410-9c4c-35f04f77a8c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:46.724172 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-5c147c24-b4c8-4410-9c4c-35f04f77a8c1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081576 Sep 15 19:19:46.725100 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 12/23] 10.222.0.18 () {64 vars in 1333 bytes} [Thu Sep 15 19:19:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:19:49.354450 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-5f2add1c-860f-4622-90ed-16a3b5b4650f admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:49.355517 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-5f2add1c-860f-4622-90ed-16a3b5b4650f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 15 19:19:49.355968 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:19:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:19:49.759638 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-430233c2-b722-45e7-88e9-65918f756146 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "swap": 0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:49.840616 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-430233c2-b722-45e7-88e9-65918f756146 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478781 Sep 15 19:19:49.841222 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 13/25] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 15 19:19:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 19:19:49.853822 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-d2c9ee02-2882-4f2a-8863-c7a505149a90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:49.936617 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-d2c9ee02-2882-4f2a-8863-c7a505149a90 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086444 Sep 15 19:19:49.952334 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 13/26] 10.222.0.18 () {64 vars in 1333 bytes} [Thu Sep 15 19:19:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:19:52.575367 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-430233c2-b722-45e7-88e9-65918f756146 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:52.576513 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-430233c2-b722-45e7-88e9-65918f756146 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Sep 15 19:19:52.580220 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:19:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:19:53.068216 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-d66ce363-683d-444a-b1fe-211002f68a90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:53.143749 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-d66ce363-683d-444a-b1fe-211002f68a90 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.560071 Sep 15 19:19:53.144676 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 14/28] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 15 19:19:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 19:19:53.157278 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-94ffaa19-c5dc-47fc-8c16-bed83f3606d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:53.162950 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG dbcounter [-] [105818] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:53.247505 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-94ffaa19-c5dc-47fc-8c16-bed83f3606d4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094010 Sep 15 19:19:53.248234 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 15/29] 10.222.0.18 () {64 vars in 1333 bytes} [Thu Sep 15 19:19:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:19:55.954692 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-d66ce363-683d-444a-b1fe-211002f68a90 admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:55.955738 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-d66ce363-683d-444a-b1fe-211002f68a90 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 15 19:19:55.956422 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:19:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:19:56.406377 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-2fafe403-47af-4ef0-8d32-105999d330cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:56.518543 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-2fafe403-47af-4ef0-8d32-105999d330cf admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.555134 Sep 15 19:19:56.519308 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 16/31] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 15 19:19:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 19:19:56.531270 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-398c9ccb-888b-4186-ad42-bc9669434217 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:56.615443 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-398c9ccb-888b-4186-ad42-bc9669434217 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087892 Sep 15 19:19:56.617151 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 16/32] 10.222.0.18 () {64 vars in 1333 bytes} [Thu Sep 15 19:19:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:19:59.219152 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-2fafe403-47af-4ef0-8d32-105999d330cf admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:19:59.220223 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-2fafe403-47af-4ef0-8d32-105999d330cf admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Sep 15 19:19:59.220622 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 17/33] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:19:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:19:59.703390 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-c1ff8ac2-c446-4b11-b945-d3e62a8eb78a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:59.709970 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:59.786355 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-c1ff8ac2-c446-4b11-b945-d3e62a8eb78a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.559224 Sep 15 19:19:59.786916 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 17/34] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 15 19:19:59 2022] POST /compute/v2.1/flavors => generated 408 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 19:19:59.800160 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-b5644091-e513-4ded-bb6f-ac6c57f53fa0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:19:59.887004 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-b5644091-e513-4ded-bb6f-ac6c57f53fa0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090777 Sep 15 19:19:59.887803 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 18/35] 10.222.0.18 () {64 vars in 1333 bytes} [Thu Sep 15 19:19:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:20:16.661924 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-c1ff8ac2-c446-4b11-b945-d3e62a8eb78a admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:16.662933 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-c1ff8ac2-c446-4b11-b945-d3e62a8eb78a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 15 19:20:16.663335 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 18/36] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:20:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:20:16.676280 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG dbcounter [-] [105818] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:17.058998 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-f04a6fba-991d-4a46-9c2b-4158826301d3 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:17.077894 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-f04a6fba-991d-4a46-9c2b-4158826301d3 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406429 Sep 15 19:20:17.078436 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1292 bytes} [Thu Sep 15 19:20:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:20:18.378431 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-c1ff8ac2-c446-4b11-b945-d3e62a8eb78a admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:18.379440 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-c1ff8ac2-c446-4b11-b945-d3e62a8eb78a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 15 19:20:18.379884 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 15 19:20:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:20:18.896868 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-63f2efe5-7bc1-4219-8333-182fd2c6ccb6 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:18.902709 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.wsgi [None req-63f2efe5-7bc1-4219-8333-182fd2c6ccb6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-63f2efe5-7bc1-4219-8333-182fd2c6ccb6 admin admin] Request method failure captured: Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Accept: application/json Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Accept-Encoding: gzip, deflate Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Connection: keep-alive Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Content-Length: 0 Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Host: 10.222.0.18 Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Openstack-Api-Version: compute 2.92 Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Openstack-System-Scope: None Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: User-Agent: python-novaclient Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Auth-Token: gAAAAABjI3ry4IaZj0mzKBKWvJaLBkTXCJepJ-q9-Ldo55h9aWJ2EPDLktNG6i1cKu2ickbo_AwG7Tdpo8bveSMg9BlA92kkuBjG37zOissHU3HiLTLTqaUTf6LPlo7Qlma1e2kIS7J01Qq2iOu9D3QRNGCZHoCUXoaoT2D8Kl1c6qE0_cDMP-A Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Domain-Id: None Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Domain-Name: None Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Identity-Status: Confirmed Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Is-Admin-Project: True Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Project-Domain-Id: default Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Project-Domain-Name: Default Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Project-Id: 6238bc86e5b040f1914e478da12747a8 Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Project-Name: admin Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Role: admin,member,reader Sep 15 19:20:18.905967 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Roles: admin,member,reader Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6238bc86e5b040f1914e478da12747a8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6238bc86e5b040f1914e478da12747a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6238bc86e5b040f1914e478da12747a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6238bc86e5b040f1914e478da12747a8"}]}] Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Tenant: admin Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Tenant-Id: 6238bc86e5b040f1914e478da12747a8 Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Tenant-Name: admin Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User: admin Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User-Domain-Id: default Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User-Domain-Name: Default Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User-Id: ddb604f3212045e99bbc5f99912931b2 Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User-Name: admin Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: method: > Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: exception: Flavor 42 could not be found. Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: action_args: {'id': '42'} Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:20:18.907583 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:20:18.908626 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:18.910586 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-63f2efe5-7bc1-4219-8333-182fd2c6ccb6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:20:18.911618 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-63f2efe5-7bc1-4219-8333-182fd2c6ccb6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389845 Sep 15 19:20:18.911618 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Sep 15 19:20:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:18.917271 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-a02c1407-350a-4578-b5d3-657afd7b915b admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:18.939878 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-a02c1407-350a-4578-b5d3-657afd7b915b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026090 Sep 15 19:20:18.940438 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Sep 15 19:20:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:20:18.951786 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-ae678e1f-4475-478b-90db-99047e462159 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:18.973984 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-ae678e1f-4475-478b-90db-99047e462159 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026893 Sep 15 19:20:18.974520 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Sep 15 19:20:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:20:18.984023 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-9e76bb83-a9b9-46dc-97a0-507e8c9742ea admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:18.989390 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.wsgi [None req-9e76bb83-a9b9-46dc-97a0-507e8c9742ea admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-9e76bb83-a9b9-46dc-97a0-507e8c9742ea admin admin] Request method failure captured: Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Accept: application/json Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Accept-Encoding: gzip, deflate Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Connection: keep-alive Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Content-Length: 0 Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Host: 10.222.0.18 Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Openstack-Api-Version: compute 2.92 Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Openstack-System-Scope: None Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: User-Agent: python-novaclient Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Auth-Token: gAAAAABjI3ry4IaZj0mzKBKWvJaLBkTXCJepJ-q9-Ldo55h9aWJ2EPDLktNG6i1cKu2ickbo_AwG7Tdpo8bveSMg9BlA92kkuBjG37zOissHU3HiLTLTqaUTf6LPlo7Qlma1e2kIS7J01Qq2iOu9D3QRNGCZHoCUXoaoT2D8Kl1c6qE0_cDMP-A Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Domain-Id: None Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Domain-Name: None Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Identity-Status: Confirmed Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Is-Admin-Project: True Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Project-Domain-Id: default Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Project-Domain-Name: Default Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Project-Id: 6238bc86e5b040f1914e478da12747a8 Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Project-Name: admin Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Role: admin,member,reader Sep 15 19:20:18.992729 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Roles: admin,member,reader Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6238bc86e5b040f1914e478da12747a8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6238bc86e5b040f1914e478da12747a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6238bc86e5b040f1914e478da12747a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6238bc86e5b040f1914e478da12747a8"}]}] Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Tenant: admin Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Tenant-Id: 6238bc86e5b040f1914e478da12747a8 Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Tenant-Name: admin Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User: admin Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User-Domain-Id: default Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User-Domain-Name: Default Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User-Id: ddb604f3212045e99bbc5f99912931b2 Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User-Name: admin Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: method: > Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: exception: Flavor 42 could not be found. Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: action_args: {'id': '42'} Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:20:18.994327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:20:18.995274 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:18.999042 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-9e76bb83-a9b9-46dc-97a0-507e8c9742ea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:20:19.000058 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-9e76bb83-a9b9-46dc-97a0-507e8c9742ea admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013945 Sep 15 19:20:19.000058 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Sep 15 19:20:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:20.210222 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-ae678e1f-4475-478b-90db-99047e462159 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:20.211249 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-ae678e1f-4475-478b-90db-99047e462159 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 15 19:20:20.212205 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 15 19:20:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:20:20.733692 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-400340d2-d552-4b50-91f2-49766de1c794 admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:20.738695 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.wsgi [None req-400340d2-d552-4b50-91f2-49766de1c794 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-400340d2-d552-4b50-91f2-49766de1c794 admin admin] Request method failure captured: Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Accept: application/json Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Accept-Encoding: gzip, deflate Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Connection: keep-alive Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Content-Length: 0 Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Host: 10.222.0.18 Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Openstack-Api-Version: compute 2.92 Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Openstack-System-Scope: None Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: User-Agent: python-novaclient Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Auth-Token: gAAAAABjI3r0fOeP08mPZqktPXE2-IlbBv5KwsGP8k1ssWYzBWkBIzRxH2otWOypZtCFWcxrz81nyU4rdPdIGtxvOYXDIq3ChxwUW88LQIjiWRz1JJz2bnJc6gmiQFQMkOIt4hNJtcpsxJiy9c2YUYX_-kxO-XIQWAkhr6m8XHAhlgzHIkfqSgM Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Domain-Id: None Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Domain-Name: None Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Identity-Status: Confirmed Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Is-Admin-Project: True Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Project-Domain-Id: default Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Project-Domain-Name: Default Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Project-Id: 6238bc86e5b040f1914e478da12747a8 Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Project-Name: admin Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Role: admin,member,reader Sep 15 19:20:20.740236 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Roles: admin,member,reader Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6238bc86e5b040f1914e478da12747a8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6238bc86e5b040f1914e478da12747a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6238bc86e5b040f1914e478da12747a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6238bc86e5b040f1914e478da12747a8"}]}] Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Tenant: admin Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Tenant-Id: 6238bc86e5b040f1914e478da12747a8 Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Tenant-Name: admin Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User: admin Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User-Domain-Id: default Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User-Domain-Name: Default Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User-Id: ddb604f3212045e99bbc5f99912931b2 Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User-Name: admin Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: method: > Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: exception: Flavor 84 could not be found. Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: action_args: {'id': '84'} Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:20:20.741817 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:20:20.742699 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:20.743848 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-400340d2-d552-4b50-91f2-49766de1c794 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:20:20.744936 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-400340d2-d552-4b50-91f2-49766de1c794 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389078 Sep 15 19:20:20.744936 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Sep 15 19:20:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 15 19:20:20.751410 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-7ce6c1a1-4bf1-46ba-9777-f435438e93dd admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:20.766459 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-7ce6c1a1-4bf1-46ba-9777-f435438e93dd admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018580 Sep 15 19:20:20.766932 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Sep 15 19:20:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:20:20.776738 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-6ead6b3f-f808-43c8-b9c4-4f2e5ceba5ca admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:20.792473 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-6ead6b3f-f808-43c8-b9c4-4f2e5ceba5ca admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019797 Sep 15 19:20:20.793000 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Sep 15 19:20:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:20:20.802639 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-bcbadd2e-fd54-435d-8a9a-4648bc47e031 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:20.807661 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.wsgi [None req-bcbadd2e-fd54-435d-8a9a-4648bc47e031 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-bcbadd2e-fd54-435d-8a9a-4648bc47e031 admin admin] Request method failure captured: Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Accept: application/json Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Accept-Encoding: gzip, deflate Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Connection: keep-alive Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Content-Length: 0 Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Host: 10.222.0.18 Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Openstack-Api-Version: compute 2.92 Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Openstack-System-Scope: None Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: User-Agent: python-novaclient Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Auth-Token: gAAAAABjI3r0fOeP08mPZqktPXE2-IlbBv5KwsGP8k1ssWYzBWkBIzRxH2otWOypZtCFWcxrz81nyU4rdPdIGtxvOYXDIq3ChxwUW88LQIjiWRz1JJz2bnJc6gmiQFQMkOIt4hNJtcpsxJiy9c2YUYX_-kxO-XIQWAkhr6m8XHAhlgzHIkfqSgM Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Domain-Id: None Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Domain-Name: None Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Identity-Status: Confirmed Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Is-Admin-Project: True Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Project-Domain-Id: default Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Project-Domain-Name: Default Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Project-Id: 6238bc86e5b040f1914e478da12747a8 Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Project-Name: admin Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Role: admin,member,reader Sep 15 19:20:20.812291 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Roles: admin,member,reader Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6238bc86e5b040f1914e478da12747a8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6238bc86e5b040f1914e478da12747a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6238bc86e5b040f1914e478da12747a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6238bc86e5b040f1914e478da12747a8"}]}] Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Tenant: admin Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Tenant-Id: 6238bc86e5b040f1914e478da12747a8 Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Tenant-Name: admin Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User: admin Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User-Domain-Id: default Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User-Domain-Name: Default Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User-Id: ddb604f3212045e99bbc5f99912931b2 Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User-Name: admin Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: method: > Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: exception: Flavor 84 could not be found. Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: action_args: {'id': '84'} Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:20:20.813923 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:20:20.815192 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:20.816591 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-bcbadd2e-fd54-435d-8a9a-4648bc47e031 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:20:20.817896 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-bcbadd2e-fd54-435d-8a9a-4648bc47e031 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011971 Sep 15 19:20:20.817896 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 24/47] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Sep 15 19:20:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:22.025722 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-6ead6b3f-f808-43c8-b9c4-4f2e5ceba5ca admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:22.026742 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-6ead6b3f-f808-43c8-b9c4-4f2e5ceba5ca admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 15 19:20:22.027135 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 24/48] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 15 19:20:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:20:22.548988 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-ab606520-62d1-4f56-b8b8-59852482655f admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:22.555147 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.wsgi [None req-ab606520-62d1-4f56-b8b8-59852482655f admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-ab606520-62d1-4f56-b8b8-59852482655f admin admin] Request method failure captured: Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Accept: application/json Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Accept-Encoding: gzip, deflate Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Connection: keep-alive Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Content-Length: 0 Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Host: 10.222.0.18 Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Openstack-Api-Version: compute 2.92 Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Openstack-System-Scope: None Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: User-Agent: python-novaclient Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Auth-Token: gAAAAABjI3r1Gv94mDruhpKoGctqtjcdJcX9pA-OQf43SJNtthZU-eDEZ1xggxH8ql3O9Atnze6_jGU45qZjAs4DNd4YJ2EER3lR-TR6BsaUUCYMIiui_Iqjh-oPgnUA0NBlTTBfIkwzJunXYqRz-cVaM2Q2hV2O88ktPLv_s5XNzChzflmt9fc Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Domain-Id: None Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Domain-Name: None Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Identity-Status: Confirmed Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Is-Admin-Project: True Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Project-Domain-Id: default Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Project-Domain-Name: Default Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Project-Id: 6238bc86e5b040f1914e478da12747a8 Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Project-Name: admin Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Role: admin,member,reader Sep 15 19:20:22.556487 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Roles: admin,member,reader Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6238bc86e5b040f1914e478da12747a8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6238bc86e5b040f1914e478da12747a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6238bc86e5b040f1914e478da12747a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6238bc86e5b040f1914e478da12747a8"}]}] Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Tenant: admin Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Tenant-Id: 6238bc86e5b040f1914e478da12747a8 Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-Tenant-Name: admin Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User: admin Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User-Domain-Id: default Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User-Domain-Name: Default Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User-Id: ddb604f3212045e99bbc5f99912931b2 Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: X-User-Name: admin Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: method: > Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: exception: Flavor 451 could not be found. Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: action_args: {'id': '451'} Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:20:22.557885 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:20:22.558832 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: ERROR nova.api.openstack.wsgi Sep 15 19:20:22.560262 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-ab606520-62d1-4f56-b8b8-59852482655f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:20:22.561499 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-ab606520-62d1-4f56-b8b8-59852482655f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.393628 Sep 15 19:20:22.561499 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 25/49] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Sep 15 19:20:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:22.567533 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-a610641b-03d7-48f1-b5d2-cf95d5a03913 admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:22.583067 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-a610641b-03d7-48f1-b5d2-cf95d5a03913 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019078 Sep 15 19:20:22.583601 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Sep 15 19:20:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:20:22.593758 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:22.608634 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018459 Sep 15 19:20:22.609167 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 26/51] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Sep 15 19:20:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:20:22.618417 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-7ef08cc7-62a7-4d7d-850e-21b7a8177c65 admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:22.623392 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.wsgi [None req-7ef08cc7-62a7-4d7d-850e-21b7a8177c65 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-7ef08cc7-62a7-4d7d-850e-21b7a8177c65 admin admin] Request method failure captured: Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Accept: application/json Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Accept-Encoding: gzip, deflate Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Connection: keep-alive Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Content-Length: 0 Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Host: 10.222.0.18 Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Openstack-Api-Version: compute 2.92 Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Openstack-System-Scope: None Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: User-Agent: python-novaclient Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Auth-Token: gAAAAABjI3r1Gv94mDruhpKoGctqtjcdJcX9pA-OQf43SJNtthZU-eDEZ1xggxH8ql3O9Atnze6_jGU45qZjAs4DNd4YJ2EER3lR-TR6BsaUUCYMIiui_Iqjh-oPgnUA0NBlTTBfIkwzJunXYqRz-cVaM2Q2hV2O88ktPLv_s5XNzChzflmt9fc Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Domain-Id: None Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Domain-Name: None Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Identity-Status: Confirmed Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Is-Admin-Project: True Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Project-Domain-Id: default Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Project-Domain-Name: Default Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Project-Id: 6238bc86e5b040f1914e478da12747a8 Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Project-Name: admin Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Role: admin,member,reader Sep 15 19:20:22.624934 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Roles: admin,member,reader Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6238bc86e5b040f1914e478da12747a8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6238bc86e5b040f1914e478da12747a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6238bc86e5b040f1914e478da12747a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6238bc86e5b040f1914e478da12747a8"}]}] Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Tenant: admin Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Tenant-Id: 6238bc86e5b040f1914e478da12747a8 Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-Tenant-Name: admin Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User: admin Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User-Domain-Id: default Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User-Domain-Name: Default Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User-Id: ddb604f3212045e99bbc5f99912931b2 Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: X-User-Name: admin Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: method: > Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: exception: Flavor 451 could not be found. Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: action_args: {'id': '451'} Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:20:22.626429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:20:22.627327 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: ERROR nova.api.openstack.wsgi Sep 15 19:20:22.629202 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-7ef08cc7-62a7-4d7d-850e-21b7a8177c65 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:20:22.630525 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-7ef08cc7-62a7-4d7d-850e-21b7a8177c65 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011481 Sep 15 19:20:22.630525 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 26/52] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Sep 15 19:20:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:23.857491 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:23.858505 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 15 19:20:23.858987 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 15 19:20:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:20:24.377659 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-a40cd06c-f9a8-429f-9ca6-730f8f3a30ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:20:24.471187 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-a40cd06c-f9a8-429f-9ca6-730f8f3a30ba admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.476697 Sep 15 19:20:24.471836 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 27/54] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Sep 15 19:20:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 19:20:25.688989 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:25.689992 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 15 19:20:25.690383 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 15 19:20:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:20:26.213855 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-6c90b490-a5d2-4695-b638-d6eb83028d7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:20:26.308388 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-6c90b490-a5d2-4695-b638-d6eb83028d7d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.479793 Sep 15 19:20:26.308942 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 28/56] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Sep 15 19:20:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 19:20:27.526974 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:27.528037 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 15 19:20:27.528432 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 15 19:20:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:20:28.047477 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-cc631292-569b-49ea-832c-aab8898ce1c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:20:28.148312 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-cc631292-569b-49ea-832c-aab8898ce1c2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.483811 Sep 15 19:20:28.148860 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 29/58] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Sep 15 19:20:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 19:20:29.369602 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:29.370613 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 15 19:20:29.371007 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 30/59] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 15 19:20:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:20:29.889511 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-4d6091c3-70a9-4d36-92db-dc37a0e7c60b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:20:29.965634 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-4d6091c3-70a9-4d36-92db-dc37a0e7c60b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.454813 Sep 15 19:20:29.966221 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 30/60] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Sep 15 19:20:29 2022] POST /compute/v2.1/flavors => generated 409 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 19:20:31.173715 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:31.175014 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 15 19:20:31.175412 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 31/61] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 15 19:20:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:20:31.689581 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-4d502384-08db-4c3f-a2a5-bd12a453473f admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:20:31.709820 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-4d502384-08db-4c3f-a2a5-bd12a453473f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397204 Sep 15 19:20:31.710362 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 31/62] 10.222.0.18 () {60 vars in 1202 bytes} [Thu Sep 15 19:20:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:21:28.399093 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:21:28.400135 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-06e38719-e97b-4bcc-9a94-888ab7cd2c00 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 15 19:21:28.400548 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 32/63] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 15 19:21:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:21:28.411190 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:21:28.791681 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-c78f6026-1f8d-48ae-a10d-e68b612c88a4 admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:21:28.811895 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-c78f6026-1f8d-48ae-a10d-e68b612c88a4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405158 Sep 15 19:21:28.812429 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 32/64] 10.222.0.18 () {60 vars in 1292 bytes} [Thu Sep 15 19:21:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:21:28.833511 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG dbcounter [-] [105818] Writing DB stats nova_api:SELECT=14 {{(pid=105818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:21:28.838344 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-3cb9eff0-aea7-40ab-9338-40880827405c admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:21:28.846028 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-3cb9eff0-aea7-40ab-9338-40880827405c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013590 Sep 15 19:21:28.846164 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 33/65] 10.222.0.18 () {60 vars in 1283 bytes} [Thu Sep 15 19:21:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:21:28.857938 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-61f2a59f-8af3-4613-8774-40b6e4f4b75c admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:21:28.865311 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-61f2a59f-8af3-4613-8774-40b6e4f4b75c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011132 Sep 15 19:21:28.865853 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 33/66] 10.222.0.18 () {60 vars in 1286 bytes} [Thu Sep 15 19:21:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:21:28.878360 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-f11c0924-1da8-4f4a-a26b-031ef490ef65 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:21:28.886458 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-f11c0924-1da8-4f4a-a26b-031ef490ef65 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012073 Sep 15 19:21:28.897781 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 34/67] 10.222.0.18 () {60 vars in 1286 bytes} [Thu Sep 15 19:21:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:21:28.899284 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-0c65a9f1-66fb-40f6-87e7-fcb3ddd44da8 admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:21:28.907310 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-0c65a9f1-66fb-40f6-87e7-fcb3ddd44da8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012304 Sep 15 19:21:28.908924 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1283 bytes} [Thu Sep 15 19:21:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:24:35.292239 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-f11c0924-1da8-4f4a-a26b-031ef490ef65 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:24:35.293313 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-f11c0924-1da8-4f4a-a26b-031ef490ef65 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Sep 15 19:24:35.293714 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 15 19:24:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:24:35.433929 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writing DB stats nova_api:SELECT=6 {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:35.596572 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-3de47029-88b4-4d4e-8bf9-46a7c30a37db admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:24:35.601622 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-3de47029-88b4-4d4e-8bf9-46a7c30a37db admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:24:35.602104 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-3de47029-88b4-4d4e-8bf9-46a7c30a37db admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:24:35.602538 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-3de47029-88b4-4d4e-8bf9-46a7c30a37db admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:24:35.603265 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-3de47029-88b4-4d4e-8bf9-46a7c30a37db admin admin] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:24:35.603744 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-3de47029-88b4-4d4e-8bf9-46a7c30a37db admin admin] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:24:35.604169 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-3de47029-88b4-4d4e-8bf9-46a7c30a37db admin admin] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:24:35.637114 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-3de47029-88b4-4d4e-8bf9-46a7c30a37db admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.204336 Sep 15 19:24:35.637696 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 35/70] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Sep 15 19:24:35 2022] GET /compute/v2.1/os-services => generated 794 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 19:24:36.746257 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-f11c0924-1da8-4f4a-a26b-031ef490ef65 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:24:36.746257 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-f11c0924-1da8-4f4a-a26b-031ef490ef65 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Sep 15 19:24:36.746257 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 15 19:24:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:24:36.935181 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-6b638a4f-8497-4471-9a15-aa2b5c61e2e0 admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:24:36.938670 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-6b638a4f-8497-4471-9a15-aa2b5c61e2e0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:24:36.939149 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-6b638a4f-8497-4471-9a15-aa2b5c61e2e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:24:36.939606 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-6b638a4f-8497-4471-9a15-aa2b5c61e2e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:24:36.940342 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-6b638a4f-8497-4471-9a15-aa2b5c61e2e0 admin admin] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:24:36.940790 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-6b638a4f-8497-4471-9a15-aa2b5c61e2e0 admin admin] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:24:36.941205 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-6b638a4f-8497-4471-9a15-aa2b5c61e2e0 admin admin] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:24:36.961768 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-6b638a4f-8497-4471-9a15-aa2b5c61e2e0 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.080894 Sep 15 19:24:36.962340 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 36/72] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Sep 15 19:24:36 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 19:24:48.443023 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-f11c0924-1da8-4f4a-a26b-031ef490ef65 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:24:48.444645 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-f11c0924-1da8-4f4a-a26b-031ef490ef65 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 15 19:24:48.445041 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 15 19:24:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:24:48.587337 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writing DB stats nova_cell0:SELECT=4 {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:48.588072 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writing DB stats nova_cell1:SELECT=4 {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:48.588678 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG dbcounter [-] [105817] Writing DB stats nova_api:SELECT=8 {{(pid=105817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:48.636288 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-51ae6ebc-0e61-42b3-8a83-43bd0562aa06 admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:24:48.639762 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-51ae6ebc-0e61-42b3-8a83-43bd0562aa06 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:24:48.640235 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-51ae6ebc-0e61-42b3-8a83-43bd0562aa06 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:24:48.640688 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-51ae6ebc-0e61-42b3-8a83-43bd0562aa06 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:24:48.641400 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-51ae6ebc-0e61-42b3-8a83-43bd0562aa06 admin admin] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:24:48.641841 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-51ae6ebc-0e61-42b3-8a83-43bd0562aa06 admin admin] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:24:48.642250 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-51ae6ebc-0e61-42b3-8a83-43bd0562aa06 admin admin] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:24:48.668898 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-51ae6ebc-0e61-42b3-8a83-43bd0562aa06 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.085936 Sep 15 19:24:48.669388 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 37/74] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Sep 15 19:24:48 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:24:49.742756 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG nova.api.openstack.wsgi [None req-f11c0924-1da8-4f4a-a26b-031ef490ef65 admin admin] Calling method '>' {{(pid=105818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:24:49.743797 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: INFO nova.api.openstack.requestlog [None req-f11c0924-1da8-4f4a-a26b-031ef490ef65 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 15 19:24:49.744199 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: [pid: 105818|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 15 19:24:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:24:49.934801 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG nova.api.openstack.wsgi [None req-4e9209d8-b827-4652-a0ab-d0fa6cd56537 admin admin] Calling method '>' {{(pid=105817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:24:49.938187 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-4e9209d8-b827-4652-a0ab-d0fa6cd56537 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:24:49.938662 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-4e9209d8-b827-4652-a0ab-d0fa6cd56537 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:24:49.939085 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-4e9209d8-b827-4652-a0ab-d0fa6cd56537 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:24:49.939942 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-4e9209d8-b827-4652-a0ab-d0fa6cd56537 admin admin] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:24:49.940367 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-4e9209d8-b827-4652-a0ab-d0fa6cd56537 admin admin] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:24:49.940777 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: DEBUG oslo_concurrency.lockutils [None req-4e9209d8-b827-4652-a0ab-d0fa6cd56537 admin admin] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:24:49.962407 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: INFO nova.api.openstack.requestlog [None req-4e9209d8-b827-4652-a0ab-d0fa6cd56537 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.079972 Sep 15 19:24:49.962906 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: [pid: 105817|app: 0|req: 38/76] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Sep 15 19:24:49 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:25:46.597830 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: Thu Sep 15 19:25:46 2022 - graceful shutdown triggered... Sep 15 19:25:46.598432 dv-cinder-849846-10-iscsi devstack@n-api.service[105817]: Gracefully killing worker 1 (pid: 105817)... Sep 15 19:25:46.598866 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: Gracefully killing worker 2 (pid: 105818)... Sep 15 19:25:46.598634 dv-cinder-849846-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 15 19:25:46.727424 dv-cinder-849846-10-iscsi devstack@n-api.service[105818]: DEBUG dbcounter [-] [105818] Writing DB stats nova_api:SELECT=4 {{(pid=105818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:47.599021 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: worker 1 buried after 1 seconds Sep 15 19:25:47.599590 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: worker 2 buried after 1 seconds Sep 15 19:25:47.599590 dv-cinder-849846-10-iscsi devstack@n-api.service[105816]: goodbye to uWSGI. Sep 15 19:25:47.600782 dv-cinder-849846-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 15 19:25:47.601946 dv-cinder-849846-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 15 19:25:47.604813 dv-cinder-849846-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 19:25:47.614689 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 19:25:47.616750 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 19:25:47 2022] *** Sep 15 19:25:47.616750 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 19:25:47.616750 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 19:25:47.616750 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: nodename: dv-cinder-849846-10-iscsi Sep 15 19:25:47.616750 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: machine: x86_64 Sep 15 19:25:47.616750 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: clock source: unix Sep 15 19:25:47.616750 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: pcre jit disabled Sep 15 19:25:47.616750 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: detected number of CPU cores: 4 Sep 15 19:25:47.616750 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: current working directory: / Sep 15 19:25:47.616750 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: detected binary path: /usr/bin/uwsgi-core Sep 15 19:25:47.617424 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: your processes number limit is 47680 Sep 15 19:25:47.617424 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: your memory page size is 4096 bytes Sep 15 19:25:47.617424 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: detected max file descriptor number: 2048 Sep 15 19:25:47.617424 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: lock engine: pthread robust mutexes Sep 15 19:25:47.617424 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: thunder lock: enabled Sep 15 19:25:47.617424 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 19:25:47.617424 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 19:25:47.656900 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: Python main interpreter initialized at 0x557794d049c0 Sep 15 19:25:47.656900 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: python threads support enabled Sep 15 19:25:47.656900 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: your server socket listen backlog is limited to 100 connections Sep 15 19:25:47.656900 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: your mercy for graceful operations on workers is 90 seconds Sep 15 19:25:47.657303 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 19:25:47.657387 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: *** Operational MODE: preforking *** Sep 15 19:25:47.657633 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: *** uWSGI is running in multiple interpreter mode *** Sep 15 19:25:47.657798 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: spawned uWSGI master process (pid: 121025) Sep 15 19:25:47.658136 dv-cinder-849846-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 19:25:47.674382 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: spawned uWSGI worker 1 (pid: 121040, cores: 1) Sep 15 19:25:47.674382 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: spawned uWSGI worker 2 (pid: 121041, cores: 1) Sep 15 19:25:47.674382 dv-cinder-849846-10-iscsi devstack@n-api.service[121025]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 19:25:48.332863 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 19:25:48.333470 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 19:25:49.496215 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 19:25:49.496215 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: from cryptography.utils import int_from_bytes Sep 15 19:25:49.496926 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 19:25:49.496926 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: from cryptography.utils import int_from_bytes Sep 15 19:25:49.500468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 19:25:49.500468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: from cryptography.utils import int_from_bytes Sep 15 19:25:49.500468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 19:25:49.500468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: from cryptography.utils import int_from_bytes Sep 15 19:25:51.920034 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 19:25:51.920624 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 19:25:51.920849 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 19:25:51.921220 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 19:25:51.921478 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 19:25:51.921872 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.922203 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.922535 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.922854 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.923193 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.923510 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.923990 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.932821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.932821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.932821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.932821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.932821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-10-iscsi {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.932821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.932821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.932821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.933996 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.933996 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.933996 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.933996 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.933996 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.933996 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.934525 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.934525 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.934525 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.934525 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.934525 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.934525 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.934525 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.934525 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.935112 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.935112 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-10-iscsi {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.935112 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.935112 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.935457 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 19:25:51.935457 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 19:25:51.936377 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.936377 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.936671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 19:25:51.936818 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.937124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 19:25:51.937280 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.937443 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 19:25:51.937590 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.937740 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.937889 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.938033 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.938248 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.938414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.938553 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.938692 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.938841 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.938984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.939202 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.939343 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.939494 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.939635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.939635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.939929 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.939929 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.940211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.940211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.940497 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.940652 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.940805 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.940805 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.941042 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-10-iscsi {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.941129 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.941213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.941302 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.941400 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.941485 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.941594 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.941756 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.941857 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.941952 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.942046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.942138 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.942231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.942322 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.942414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.942504 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.942504 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.942668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.942763 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.942848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.942931 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.943026 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.943119 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.943211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.943296 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.943388 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.943838 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.943960 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.944048 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.944180 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.944272 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.944367 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.944521 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.944621 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.945355 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.945456 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.945680 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.945773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.946000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.946143 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-10-iscsi {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.946326 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.946459 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.946641 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.946772 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.946965 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.947084 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.947368 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.947495 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.947624 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.947833 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.947961 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.948147 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.948329 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.948468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.948657 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.948801 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.948974 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.949109 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.949296 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.949593 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.949717 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.949806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.949926 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.950095 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.950237 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.950416 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.950574 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.950719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.950859 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.951027 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.951198 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.951335 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.951509 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.951672 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.951834 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.951980 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.952118 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.952284 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.952429 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.952529 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.952753 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.952852 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.953065 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.953173 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.953378 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.953478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.953762 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.953938 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.954029 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.954128 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.954214 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.954306 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.954527 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.954639 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.954848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.954953 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.955156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.955248 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.955464 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.955556 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.955915 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.956035 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.956130 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.956214 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.956431 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.956574 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.956742 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.956864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.957050 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.957187 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.957375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.957722 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.957856 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.957979 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.958854 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.959021 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.959021 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.959332 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.959490 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.959634 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.959843 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.959989 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.960133 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.960966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.961132 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.961289 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.961448 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.961604 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.961748 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.961897 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.962042 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.962196 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.962349 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.962492 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.962641 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.962791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.962934 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.968134 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.975489 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.976304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.976411 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.976500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.976585 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.976684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.976684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.976848 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.977007 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.977101 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.977191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.977284 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.977379 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.977465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.977549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.977640 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.977807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.977896 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.977996 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.978109 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.978201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.978293 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.978386 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.978472 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.978562 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.978653 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.978738 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.978827 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.978947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.979041 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.979127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.979210 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.979293 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.979374 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.979471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.979556 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.979639 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.979862 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.979959 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.980057 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.980144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.980234 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.980324 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.980415 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.980509 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.980509 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.980679 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.980771 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.980866 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.980951 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.981042 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.981140 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.981227 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.981317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.981409 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.981506 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.981591 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.981682 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.981778 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.981869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.981963 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.982058 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.982150 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.982241 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.982326 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.982422 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.982508 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.982601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.982690 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.982773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.982856 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.982948 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.983038 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.983128 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.983218 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.983307 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.983397 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.983490 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.983574 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.987735 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.987872 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.987974 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.988053 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.988149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.988244 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.988329 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.988404 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.988475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.988557 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.988638 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.988731 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.988842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.988931 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.989011 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.989011 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.989158 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.989231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.989300 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.989370 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.989447 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.989537 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.989611 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.989695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.989779 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.989876 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.990004 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.990097 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.990179 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.990259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.990332 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.990401 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.990480 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.990574 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:25:51.990688 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.990763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.990835 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.990905 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.990982 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.991068 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.991148 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.991249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.991324 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.991401 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.991475 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.995614 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.995754 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.995845 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.995929 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.996010 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.996083 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.996165 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.996405 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.996497 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.996707 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.996786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.996865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.996947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.997203 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.997296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.997502 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.997581 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.997782 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.997875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.997951 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.998030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.998118 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.998200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.998289 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.998363 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.998728 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.998888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:51.999035 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.000627 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.000912 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.001067 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.001215 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.001361 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.001518 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.001671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.001838 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.002045 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.002228 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.002382 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.002543 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.002543 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.002910 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.003110 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.003291 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.003447 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.003599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.003812 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.003975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.004179 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.004343 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.004495 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.004647 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.004849 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.005014 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.005175 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.005326 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.006221 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.006387 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.006624 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.006624 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.006624 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.006624 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.006624 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.006624 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.006624 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.006624 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.008711 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.008711 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.008711 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.009152 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.009313 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.009477 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.009630 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.009789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.009949 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.010116 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.010269 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.010477 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.010677 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.010844 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.010998 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.011158 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.011318 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.011471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.011643 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.011643 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.011996 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.012157 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.012317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.012517 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.012682 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.012834 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.012994 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.013153 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.013312 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.013471 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.013631 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.013802 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.013962 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.014124 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.014275 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.014434 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.014593 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.014745 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.014906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.015082 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.016434 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.016660 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.016856 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.017015 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.017244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.017403 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.017564 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.017724 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.017884 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.018050 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.018211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.018372 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.018524 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.018685 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.018846 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.019008 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.019171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.019331 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.019490 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.019673 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.019834 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.020003 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.020157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.020324 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.021469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.021674 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.021845 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.022014 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.022176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.022343 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.022503 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.022655 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.022832 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.022992 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.023152 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.023312 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.023472 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.023624 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.023832 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.023995 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.024156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.024306 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.024430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.024542 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.024667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.024780 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.024976 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.025096 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.025208 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.025329 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.025329 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.025557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.025669 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.025797 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.026554 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.026688 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.026811 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.026924 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.027044 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.027164 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.027323 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.027457 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.027604 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.027740 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.029986 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.030160 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.030325 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.030506 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.030704 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.030863 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.031023 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.031176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.031328 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.031529 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.031714 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.031884 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.032046 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.032198 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.032364 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.032519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.032689 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.032875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.033202 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.033364 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.033573 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.033739 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.033900 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.034052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.034204 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.034356 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.034526 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.034680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.034832 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.035031 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.035184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.035343 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.035506 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.035678 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.035849 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.036185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.036823 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.037063 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.037232 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.037475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.037475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.038443 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.038443 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.038810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.039057 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.039216 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.039368 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.039520 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.039755 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.039931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.040093 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.040247 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.040407 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.040559 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.040710 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.040885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.041076 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.041274 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.041477 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.041636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.041846 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.042009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.042169 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.042330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.042483 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.042483 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.042483 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.042483 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.042483 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.042483 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.042483 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.043614 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.043880 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.044038 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.044198 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.044359 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.044518 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.044670 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.044835 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.044995 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.045251 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.045251 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.045564 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.045749 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.045920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.046082 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.046858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.047026 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.047189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.047353 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.047554 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.047743 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.047901 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.048066 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.048219 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.048381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.048542 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.048703 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.048862 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.049041 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.049284 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.049458 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.049458 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.049769 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.049769 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.050067 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.050230 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.050398 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.050551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.050711 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.050863 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.051015 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.051015 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.051315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.051476 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.051636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.051923 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.052071 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.063949 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.064162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.064325 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.064491 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.064649 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.064803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.064976 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.065130 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.065130 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.065423 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.065575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.065737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.065904 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.066078 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.066231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.066384 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.066807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.066807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.067130 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.067320 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.067913 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.068092 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.068264 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.068427 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.068580 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.068739 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.068905 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.069071 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.069240 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.069413 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.069698 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.070350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.070505 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.070667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.070821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.071003 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.071924 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.072109 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.072281 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.072447 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.072625 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.072788 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.072950 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.073103 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.073264 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.073426 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.073587 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.073739 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.073998 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.074159 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.074321 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.074485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.074659 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.074821 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.074983 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.075147 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.075308 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.075463 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.075623 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.075858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.076017 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.076185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.076348 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.076501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.076704 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.077086 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.077297 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.077466 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.077653 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.078208 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.078368 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.078522 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.078683 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.078871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.079523 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.079818 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.079990 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.080166 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.080337 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.080493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.080654 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.080817 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.080979 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.081132 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.081295 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.081449 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.081609 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.081763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.081763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.082061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.082061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.082376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.082529 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.082689 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.082844 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.082996 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.083158 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.083320 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.083474 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.083627 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.083807 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.084086 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.084332 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.084503 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.084666 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.084841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.085531 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.085713 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.085869 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.086023 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.086184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.086184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.086493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.086657 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.086811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.087256 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.087733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.087938 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.091116 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.091300 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.091300 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.091604 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.091807 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.091966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.092183 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.092347 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.092508 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.092661 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.092829 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.092980 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.093142 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.093344 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.093504 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.093656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.093862 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.093862 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.095458 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.095586 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.095767 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.101569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.101747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.101930 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.102097 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.102261 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.102425 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.102595 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.102775 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.102930 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.103083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.103243 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.103397 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.103560 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.103744 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.103901 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.104077 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.104232 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.104384 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.104638 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.104811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.104973 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.105127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.105287 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.105450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.105613 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.105767 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.105928 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.106094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.106257 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.106420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.106583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.106745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.106908 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.107071 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.107252 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.107635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.107850 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.108013 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.108324 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.108507 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.108676 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.108840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.109008 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.109171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.109334 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.109521 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.109748 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.109888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.109985 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.110080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.110175 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.110262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.110357 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.110486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.110609 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.110802 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.111598 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.111827 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.111971 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.112097 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.112213 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.112340 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.112454 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.112565 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.112696 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.112815 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.112936 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.113050 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.113163 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.113289 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.113403 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.113515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.113634 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.113746 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.113867 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.113990 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.114103 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.114216 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.114328 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.114438 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.114549 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.114772 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.114902 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.115024 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.115137 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.115249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.115361 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.115482 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.115595 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.115796 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.115925 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.116050 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.116179 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.116293 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.116416 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.117043 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.117167 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.117279 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.117406 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.117783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.117910 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.118032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.118145 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.118317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.118450 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.118573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.118701 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.118824 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.118945 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.119057 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.119186 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.119307 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.119428 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.119542 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.119693 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.119827 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.119959 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.120072 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.120197 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.120309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.120421 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.120548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.120662 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.120773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.120957 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.121111 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.121466 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.121847 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.121847 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.122079 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.122192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.122304 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.122413 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.122544 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.122658 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.122776 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.122897 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.123008 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.123141 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.123260 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.123381 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.123493 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.123611 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.123806 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.123946 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.124061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.124173 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.124333 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.124454 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.124566 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.124692 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.124905 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.125034 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.125156 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.125269 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.125269 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.125536 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.125658 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.125771 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.125889 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.126052 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.126178 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.126302 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.126416 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.126527 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.126637 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.126754 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.126875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.126989 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.127099 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.127210 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.127320 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.127430 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.127550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.127938 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.128074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.128202 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.128369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.128500 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.128629 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.128750 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.128863 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.128983 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.129096 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.129217 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.129217 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.130013 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.130128 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.130240 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.130351 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.130478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.130591 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.130702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.130813 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.130924 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.130924 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.131158 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.131280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.131698 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.132059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.132276 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.132884 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.133010 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.133131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.133249 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.133362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.133482 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.133610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.133724 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.133835 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.133962 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.134083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.134205 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.134326 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.134450 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.134571 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.134684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.134795 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.134926 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.134926 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.134926 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.134926 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.134926 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.135576 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.135909 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.136096 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.136263 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.136427 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.136427 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.136721 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.136956 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.137240 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.137402 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.137556 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.137717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.138115 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.138290 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.138514 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.139253 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.139426 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.139589 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.139786 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.139953 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.140116 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.140337 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.140508 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.140508 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.140809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.140809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.141114 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.141275 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.141429 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.141827 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.155379 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.155516 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.155625 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.155625 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.155855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.155956 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.156046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.156134 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.156221 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.156307 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.156419 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.156530 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.156620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.156715 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.156809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.156904 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.157005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.157101 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.157188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.157274 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.157359 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.157452 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.157547 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.157655 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.157750 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.157838 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.157931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.158042 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.158042 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.158238 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.158372 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.158462 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.158573 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.158668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.158668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.158854 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.158947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.159041 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.159127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.159225 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.159321 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.159408 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.159492 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.159577 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.159679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.159782 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.159878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.159971 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.160064 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.160158 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.160251 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.160347 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.160347 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.160520 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.160607 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.160698 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.160785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.160878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.160965 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.161057 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.161143 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.161234 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.161329 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.161416 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.161500 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.161572 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.161655 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.161655 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.161803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.161932 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.162028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.162115 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.162199 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.162291 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.162390 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.162478 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.162563 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.162654 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.162740 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.162824 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.162918 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.163012 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.163097 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.163189 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.163281 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.163376 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.163502 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.163596 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.163746 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.163844 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.163938 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.164034 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.164122 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.164744 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.164847 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.164936 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.165030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.165118 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.165203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.165298 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.165298 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.165298 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.165298 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.165637 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.165724 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.165837 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.165933 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.165933 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.166296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.166398 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.166485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.166655 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.166754 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.166835 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.166939 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.167073 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.167166 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.167166 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.167336 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.167430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.167517 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.167610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.167753 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.167844 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.167930 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.168014 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.168100 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.168191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.168288 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.168375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.168468 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.168556 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.168642 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.168735 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.168836 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.168930 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.169018 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.169109 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.169196 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.169295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.169391 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.169477 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.169562 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.169647 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.169732 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.169826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.169920 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.170008 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.170107 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.170195 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.170195 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.170369 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.170463 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.170550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.170643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.170738 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.170835 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.170923 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.171016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.171112 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.171206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.171293 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.171386 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.171474 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.171567 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.171679 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.171779 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.171867 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.171867 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.172039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.172126 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.172211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.172295 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.172393 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.172481 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.172566 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.172658 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.172744 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.172829 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.172927 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.173014 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.173106 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.173201 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.173295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.173370 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.173451 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.173546 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.173643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.173731 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.173815 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.173910 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.174004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.174091 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.174183 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.174279 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.174382 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.174382 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.174567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.174654 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.174746 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.174832 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.174916 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.174916 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.175203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.175314 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.175410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.175504 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.175591 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.175712 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.175802 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.175895 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.175990 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.176079 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.176174 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.176307 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.176404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.176492 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.176576 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.176669 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.176768 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.176872 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.176962 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.177055 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.177149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.177244 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.177342 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.177441 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.178738 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.178867 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.178958 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.179556 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.179668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.179668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.179907 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.179995 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.180081 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.180202 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.180308 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.180409 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.180504 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.180604 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.180693 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.180792 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.180881 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.180974 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.181072 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.181072 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.181237 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.181338 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.181427 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.181544 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.181639 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.181727 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.181834 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.181932 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.182025 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.182125 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.182272 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.182365 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.182478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.182575 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.182662 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.182756 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.182848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.182936 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.182936 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.183115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.183202 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.183331 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.183426 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.183512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.183607 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.183796 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.183940 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.184044 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.184141 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.184238 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.184334 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.184420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.184514 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.184607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.184694 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.184793 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.184885 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.184979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.185055 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.185149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.185239 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.185341 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.185436 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.185574 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.185705 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.185817 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.185989 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.186079 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.186153 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.186237 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.186335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.186475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.186580 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.186676 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.186764 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.186849 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.186934 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.187026 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.187127 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.187214 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.187308 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.187308 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.187474 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.187566 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.187774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.187867 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.187966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.188055 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.188140 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.188236 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.188323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.188410 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.188509 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.188605 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.188750 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.188750 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.188983 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.189072 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.189165 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.189165 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.189336 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.189435 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.189523 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.189608 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.189692 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.189777 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.189777 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.189945 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.189945 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.190200 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.190298 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.190373 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.190468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.190564 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.190651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.190737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.190822 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.190915 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.191019 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.191114 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.191201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.191298 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.191386 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.191478 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.191573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.191697 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.191795 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.191889 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.191984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.192080 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.192174 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.192174 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.192377 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.192480 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.192575 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.192575 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.192575 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.192823 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.192919 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.193006 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.193099 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.193196 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.193291 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.193377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.193511 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.193607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.193708 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.193796 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.193881 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.193966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.194099 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.194200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.194302 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.194396 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.194495 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.194589 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.194731 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.195309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.195410 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.195497 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.195592 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.195765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.195765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.195990 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.196095 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.196184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.196269 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.196354 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.196447 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.196588 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.196693 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.196789 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.196882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.196969 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.197055 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.197153 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.197241 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.197330 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.197403 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.197403 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.197543 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.197641 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.197729 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.197813 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.197898 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.197898 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.198062 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.198062 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.198219 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.198311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.198397 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.198494 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.198589 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.198589 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.198759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.198854 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.198928 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.199000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.199083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.199170 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.199254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.199339 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.199429 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.199526 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.199626 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.199778 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.199881 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.199977 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.200072 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.200168 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.200294 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.200389 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.200483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.200578 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.200706 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.200848 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.200947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.201036 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.201121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.201206 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.201206 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.201384 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.201477 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.201564 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.201766 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.201877 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.202074 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.202246 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.202384 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.202674 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.202772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.203012 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.203120 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.203323 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.203811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.203912 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.204001 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.204088 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.204172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.204247 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.204341 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.204563 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.204668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.204969 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.205080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.205315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.205655 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.205967 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.206149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.206307 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.206551 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.206710 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.206871 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.207024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.207189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.207356 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.207517 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.207705 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.207867 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.208031 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.208185 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.208347 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.208501 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.208655 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.208808 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.208968 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.209122 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.209384 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.209706 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.210051 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.210409 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.210547 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.210734 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.210873 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.211057 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.211195 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.211377 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.211513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.211764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.212101 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.212435 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.212715 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.212854 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.213082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.213227 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.213414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.213551 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.213732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.213870 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.214049 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.214188 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.214362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.214515 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.214687 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.214832 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.215021 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.215172 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.215339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.215484 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.215666 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.215819 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.216082 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.216235 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.216370 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.216502 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.216643 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.216788 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.216962 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.217099 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.217284 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.217421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.217608 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.217760 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.217933 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.218074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.218252 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.218397 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.218571 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.218719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.218898 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.219046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.219219 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.219357 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.219554 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.219724 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.219910 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.220047 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.220226 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.220369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.220517 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.220658 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.220824 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.220968 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.221132 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.221290 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.221432 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.221566 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.221770 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.221942 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.222080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.222308 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.222456 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.222635 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.222770 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.222954 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.223090 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.223262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.223408 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.223542 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 19:25:52.223694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.223888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.224195 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.224506 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.224807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.225110 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.225414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.225720 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.226049 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.226356 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.226664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.226968 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.227275 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.227577 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.227910 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.228214 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.228593 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.228925 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.229265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.229564 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.229877 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.230200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.230514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.230838 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.231163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.231483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.231844 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.235806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.235806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.235806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.235806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.235806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.235806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.235806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.235806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.236777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.236777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.236777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.236777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.236777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.236777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.236777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.237496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.237496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.237496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.237824 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.238124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.238381 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.238698 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.239011 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.239375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.239638 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.239977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.240306 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.240632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.240943 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.242008 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.242404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.242759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.243077 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.243431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.243788 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.244110 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.244427 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.244739 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:25:52.244981 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 19:25:52.285519 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO dbcounter [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] Registered counter for database nova_api Sep 15 19:25:52.306503 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_db.sqlalchemy.engines [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:25:52.307472 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO dbcounter [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] Registered counter for database nova_api Sep 15 19:25:52.313207 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writer thread running {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:25:52.327978 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_db.sqlalchemy.engines [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:25:52.334499 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writer thread running {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:25:52.370459 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.context [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25eb2376-64df-4345-a21d-3047a261cd80(cell1) {{(pid=121040) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 19:25:52.374538 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:25:52.375015 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:25:52.376644 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:25:52.377381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:25:52.377828 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:25:52.379891 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:25:52.381885 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO dbcounter [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] Registered counter for database nova_cell0 Sep 15 19:25:52.386002 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO dbcounter [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] Registered counter for database nova_cell1 Sep 15 19:25:52.390890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.context [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25eb2376-64df-4345-a21d-3047a261cd80(cell1) {{(pid=121041) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 19:25:52.394291 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_db.sqlalchemy.engines [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:25:52.394874 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_db.sqlalchemy.engines [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:25:52.395011 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:25:52.395471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:25:52.397113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:25:52.397880 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:25:52.398319 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:25:52.400385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:25:52.400525 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writer thread running {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:25:52.402400 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO dbcounter [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] Registered counter for database nova_cell0 Sep 15 19:25:52.403144 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writer thread running {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:25:52.406534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO dbcounter [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] Registered counter for database nova_cell1 Sep 15 19:25:52.416300 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_db.sqlalchemy.engines [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:25:52.418485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_db.sqlalchemy.engines [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:25:52.425726 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writer thread running {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:25:52.427067 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writer thread running {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:25:52.553153 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO dbcounter [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] Registered counter for database nova_cell0 Sep 15 19:25:52.560638 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_db.sqlalchemy.engines [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:25:52.565165 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writer thread running {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:25:52.575291 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO dbcounter [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] Registered counter for database nova_cell0 Sep 15 19:25:52.582033 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_db.sqlalchemy.engines [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:25:52.586758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writer thread running {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:25:52.883512 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: WARNING keystonemiddleware.auth_token [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 19:25:52.890803 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: WARNING keystonemiddleware.auth_token [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 19:25:52.919361 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: WARNING keystonemiddleware.auth_token [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 19:25:52.927599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: WARNING keystonemiddleware.auth_token [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 19:25:53.236588 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: WARNING keystonemiddleware.auth_token [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 19:25:53.243212 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: WARNING keystonemiddleware.auth_token [None req-78b67837-506c-47fa-aede-ae6ccb9301ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 19:25:53.248597 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557794d049c0 pid: 121040 (default app) Sep 15 19:25:53.275603 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: WARNING keystonemiddleware.auth_token [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 19:25:53.281668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: WARNING keystonemiddleware.auth_token [None req-eeaddd5d-7716-4969-9003-c921029798bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 19:25:53.287939 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557794d049c0 pid: 121041 (default app) Sep 15 19:26:31.019437 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:31.022319 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:31.023365 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:31.024256 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:31.338322 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:31.339143 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:31.340060 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:31.340806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:32.626205 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f0995b71-a4f1-4574-b972-9e570b719be4 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] Action: 'create', calling method: .version_select at 0x7f551fb3d4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-506345600", "metadata": {"Type": "work"}}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:26:32.953622 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cbb517e2-58cc-4362-8ada-babb2a463ec7 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Action: 'create', calling method: .version_select at 0x7f551fb3c430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1982963706", "metadata": {"Type": "work"}}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cbb517e2-58cc-4362-8ada-babb2a463ec7 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Request method failure captured: Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 122 Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3xneh8LfKnnGMmabZ0MOJMzGsX4cudz0Ojw6zjiefeVL96kVMdpafV8WAroWMlmra9ppcyTpQxAY8eeyncSitukgPKNAEeVbR6lAwYq63m9iJK2-_j9isV_-xIzuTHwk5iLHppsYH5AOtp7ODmpf5gKRgrWG7rFO8zgHfvk-fMKm3w Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 064ccd91385d4f7db985421d083e4b95 Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:26:32.962887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:26:32.964496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_064ccd91385d4f7db985421d083e4b95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/064ccd91385d4f7db985421d083e4b95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/064ccd91385d4f7db985421d083e4b95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/064ccd91385d4f7db985421d083e4b95"}]}] Sep 15 19:26:32.964496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:32.964496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 064ccd91385d4f7db985421d083e4b95 Sep 15 19:26:32.964496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:32.964496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesNegativeTest-535499324-project Sep 15 19:26:32.964496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:26:32.964496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:26:32.964496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 9823a946acd148f0baf138b53bc1edf7 Sep 15 19:26:32.964496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesNegativeTest-535499324-project Sep 15 19:26:32.964496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Sep 15 19:26:32.964496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1982963706", "metadata": {"Type": "work"}}} Sep 15 19:26:32.964496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: Sep 15 19:26:32.964496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1982963706', 'metadata': {'Type': 'work'}}}} Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise error Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi '#$%' Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:26:32.965352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 19:26:32.966664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 19:26:32.967833 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 19:26:32.967833 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.967833 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cbb517e2-58cc-4362-8ada-babb2a463ec7 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:26:32.967833 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cbb517e2-58cc-4362-8ada-babb2a463ec7 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.632006 Sep 15 19:26:32.967833 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1156 bytes} [Thu Sep 15 19:26:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1634 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 19:26:32.974258 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ffb65966-16ee-4534-99d0-9ef48f1de609 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Action: 'create', calling method: .version_select at 0x7f551fb3cd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1791740792", "metadata": {"Type": "work"}}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ffb65966-16ee-4534-99d0-9ef48f1de609 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Request method failure captured: Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 120 Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3xneh8LfKnnGMmabZ0MOJMzGsX4cudz0Ojw6zjiefeVL96kVMdpafV8WAroWMlmra9ppcyTpQxAY8eeyncSitukgPKNAEeVbR6lAwYq63m9iJK2-_j9isV_-xIzuTHwk5iLHppsYH5AOtp7ODmpf5gKRgrWG7rFO8zgHfvk-fMKm3w Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 064ccd91385d4f7db985421d083e4b95 Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:26:32.980684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:26:32.982410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_064ccd91385d4f7db985421d083e4b95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/064ccd91385d4f7db985421d083e4b95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/064ccd91385d4f7db985421d083e4b95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/064ccd91385d4f7db985421d083e4b95"}]}] Sep 15 19:26:32.982410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:32.982410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 064ccd91385d4f7db985421d083e4b95 Sep 15 19:26:32.982410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:32.982410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesNegativeTest-535499324-project Sep 15 19:26:32.982410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:26:32.982410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:26:32.982410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 9823a946acd148f0baf138b53bc1edf7 Sep 15 19:26:32.982410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesNegativeTest-535499324-project Sep 15 19:26:32.982410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Sep 15 19:26:32.982410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1791740792", "metadata": {"Type": "work"}}} Sep 15 19:26:32.982410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: Sep 15 19:26:32.982410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1791740792', 'metadata': {'Type': 'work'}}}} Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise error Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi '0' Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:26:32.983233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 19:26:32.984601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 19:26:32.985684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 19:26:32.985684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:32.985684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ffb65966-16ee-4534-99d0-9ef48f1de609 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:26:32.985684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ffb65966-16ee-4534-99d0-9ef48f1de609 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012217 Sep 15 19:26:32.985684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 2/2] 10.222.0.18 () {60 vars in 1156 bytes} [Thu Sep 15 19:26:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 19:26:32.992149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a862f853-6257-4e29-b2cf-089f24fee952 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Action: 'create', calling method: .version_select at 0x7f551f9f9160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1611860429", "metadata": {"Type": "work"}}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a862f853-6257-4e29-b2cf-089f24fee952 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Request method failure captured: Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 119 Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3xneh8LfKnnGMmabZ0MOJMzGsX4cudz0Ojw6zjiefeVL96kVMdpafV8WAroWMlmra9ppcyTpQxAY8eeyncSitukgPKNAEeVbR6lAwYq63m9iJK2-_j9isV_-xIzuTHwk5iLHppsYH5AOtp7ODmpf5gKRgrWG7rFO8zgHfvk-fMKm3w Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 064ccd91385d4f7db985421d083e4b95 Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:26:33.002176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:26:33.003804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_064ccd91385d4f7db985421d083e4b95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/064ccd91385d4f7db985421d083e4b95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/064ccd91385d4f7db985421d083e4b95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/064ccd91385d4f7db985421d083e4b95"}]}] Sep 15 19:26:33.003804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:33.003804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 064ccd91385d4f7db985421d083e4b95 Sep 15 19:26:33.003804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:33.003804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesNegativeTest-535499324-project Sep 15 19:26:33.003804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:26:33.003804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:26:33.003804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 9823a946acd148f0baf138b53bc1edf7 Sep 15 19:26:33.003804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesNegativeTest-535499324-project Sep 15 19:26:33.003804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Sep 15 19:26:33.003804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1611860429", "metadata": {"Type": "work"}}} Sep 15 19:26:33.003804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: Sep 15 19:26:33.003804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1611860429', 'metadata': {'Type': 'work'}}}} Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise error Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi '' Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:26:33.004747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 19:26:33.007309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 19:26:33.009768 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 19:26:33.009768 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:33.009768 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a862f853-6257-4e29-b2cf-089f24fee952 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:26:33.009768 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a862f853-6257-4e29-b2cf-089f24fee952 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016058 Sep 15 19:26:33.011220 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 3/3] 10.222.0.18 () {60 vars in 1156 bytes} [Thu Sep 15 19:26:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 19:26:33.017243 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e99322c2-2485-42b2-a7a0-3feba549661a tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Calling method '.version_select at 0x7f551f9f9b80>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:34.394550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-e99322c2-2485-42b2-a7a0-3feba549661a tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] HTTP exception thrown: Volume tempest-invalid-503103542 could not be found. Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e99322c2-2485-42b2-a7a0-3feba549661a tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Request method failure captured: Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-503103542 HTTP/1.1 Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3xneh8LfKnnGMmabZ0MOJMzGsX4cudz0Ojw6zjiefeVL96kVMdpafV8WAroWMlmra9ppcyTpQxAY8eeyncSitukgPKNAEeVbR6lAwYq63m9iJK2-_j9isV_-xIzuTHwk5iLHppsYH5AOtp7ODmpf5gKRgrWG7rFO8zgHfvk-fMKm3w Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 064ccd91385d4f7db985421d083e4b95 Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:26:34.400468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:26:34.401410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_064ccd91385d4f7db985421d083e4b95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/064ccd91385d4f7db985421d083e4b95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/064ccd91385d4f7db985421d083e4b95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/064ccd91385d4f7db985421d083e4b95"}]}] Sep 15 19:26:34.401410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:34.401410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 064ccd91385d4f7db985421d083e4b95 Sep 15 19:26:34.401410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:34.401410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesNegativeTest-535499324-project Sep 15 19:26:34.401410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:26:34.401410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:26:34.401410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 9823a946acd148f0baf138b53bc1edf7 Sep 15 19:26:34.401410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesNegativeTest-535499324-project Sep 15 19:26:34.401410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: Sep 15 19:26:34.401410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Volume tempest-invalid-503103542 could not be found. Sep 15 19:26:34.401410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'tempest-invalid-503103542'} Sep 15 19:26:34.401410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-503103542 could not be found. (HTTP 404) (Request-ID: req-8013ec8b-b282-4e24-bf0a-b2ff1abed614) Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:34.401977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 19:26:34.402883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-503103542 could not be found. Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:26:34.403709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-503103542 could not be found. Sep 15 19:26:34.404548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.404548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:34.404548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.404548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:34.404548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:34.404548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:34.404548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:26:34.404548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:26:34.404548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-503103542 could not be found. Sep 15 19:26:34.404548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.404548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e99322c2-2485-42b2-a7a0-3feba549661a tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Returning 404 to user: Volume tempest-invalid-503103542 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:26:34.404548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e99322c2-2485-42b2-a7a0-3feba549661a tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-503103542" status: 404 len: 98 microversion: 2.1 time: 1.390278 Sep 15 19:26:34.415237 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 4/4] 10.222.0.18 () {58 vars in 1215 bytes} [Thu Sep 15 19:26:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-503103542 => generated 98 bytes in 1404 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 15 19:26:34.437380 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6e515892-c3cb-437b-9b92-a2951d4a8f8b tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011317 Sep 15 19:26:34.449368 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 5/5] 10.222.0.18 () {58 vars in 1140 bytes} [Thu Sep 15 19:26:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 15 19:26:34.455236 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-27488212-2228-4a1c-a6af-869c5f299bf4 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009358 Sep 15 19:26:34.457546 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 6/6] 10.222.0.18 () {58 vars in 1137 bytes} [Thu Sep 15 19:26:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 15 19:26:34.475863 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-68f5186c-b7bb-4ff6-9bb3-0ad7c9b0f103 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Calling method '.version_select at 0x7f551f92c3a0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:34.848554 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-68f5186c-b7bb-4ff6-9bb3-0ad7c9b0f103 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] HTTP exception thrown: Volume 243d4f4b-7764-4f5e-898b-dfdef77d90d2 could not be found. Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-68f5186c-b7bb-4ff6-9bb3-0ad7c9b0f103 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Request method failure captured: Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/os-volumes/243d4f4b-7764-4f5e-898b-dfdef77d90d2 HTTP/1.1 Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3xneh8LfKnnGMmabZ0MOJMzGsX4cudz0Ojw6zjiefeVL96kVMdpafV8WAroWMlmra9ppcyTpQxAY8eeyncSitukgPKNAEeVbR6lAwYq63m9iJK2-_j9isV_-xIzuTHwk5iLHppsYH5AOtp7ODmpf5gKRgrWG7rFO8zgHfvk-fMKm3w Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 064ccd91385d4f7db985421d083e4b95 Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:26:34.851894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:26:34.853070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_064ccd91385d4f7db985421d083e4b95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/064ccd91385d4f7db985421d083e4b95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/064ccd91385d4f7db985421d083e4b95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/064ccd91385d4f7db985421d083e4b95"}]}] Sep 15 19:26:34.853070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:34.853070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 064ccd91385d4f7db985421d083e4b95 Sep 15 19:26:34.853070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:34.853070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesNegativeTest-535499324-project Sep 15 19:26:34.853070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:26:34.853070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:26:34.853070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 9823a946acd148f0baf138b53bc1edf7 Sep 15 19:26:34.853070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesNegativeTest-535499324-project Sep 15 19:26:34.853070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: Sep 15 19:26:34.853070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Volume 243d4f4b-7764-4f5e-898b-dfdef77d90d2 could not be found. Sep 15 19:26:34.853070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '243d4f4b-7764-4f5e-898b-dfdef77d90d2'} Sep 15 19:26:34.853070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 243d4f4b-7764-4f5e-898b-dfdef77d90d2 could not be found. (HTTP 404) (Request-ID: req-8fcc426a-23a7-434e-8777-64369f00f840) Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:34.853664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 19:26:34.854550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 243d4f4b-7764-4f5e-898b-dfdef77d90d2 could not be found. Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 19:26:34.855404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:26:34.857777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 243d4f4b-7764-4f5e-898b-dfdef77d90d2 could not be found. Sep 15 19:26:34.857777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.857777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:34.857777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.857777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:34.857777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:34.857777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:34.857777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:26:34.857777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:26:34.857777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 243d4f4b-7764-4f5e-898b-dfdef77d90d2 could not be found. Sep 15 19:26:34.857777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:34.857777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-68f5186c-b7bb-4ff6-9bb3-0ad7c9b0f103 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Returning 404 to user: Volume 243d4f4b-7764-4f5e-898b-dfdef77d90d2 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:26:34.857777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-68f5186c-b7bb-4ff6-9bb3-0ad7c9b0f103 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/243d4f4b-7764-4f5e-898b-dfdef77d90d2" status: 404 len: 109 microversion: 2.1 time: 0.392726 Sep 15 19:26:34.859557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 7/7] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 15 19:26:34 2022] DELETE /compute/v2.1/os-volumes/243d4f4b-7764-4f5e-898b-dfdef77d90d2 => generated 109 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:26:34.871180 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-db96b26f-b6d7-4f02-a9b7-af02fab561c5 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Calling method '.version_select at 0x7f551f92c160>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-db96b26f-b6d7-4f02-a9b7-af02fab561c5 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] HTTP exception thrown: Volume 0669e2ad-ddfa-424f-99c5-0a2dc37c0669 could not be found. Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-db96b26f-b6d7-4f02-a9b7-af02fab561c5 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Request method failure captured: Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/os-volumes/0669e2ad-ddfa-424f-99c5-0a2dc37c0669 HTTP/1.1 Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3xneh8LfKnnGMmabZ0MOJMzGsX4cudz0Ojw6zjiefeVL96kVMdpafV8WAroWMlmra9ppcyTpQxAY8eeyncSitukgPKNAEeVbR6lAwYq63m9iJK2-_j9isV_-xIzuTHwk5iLHppsYH5AOtp7ODmpf5gKRgrWG7rFO8zgHfvk-fMKm3w Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 064ccd91385d4f7db985421d083e4b95 Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:26:35.118921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:26:35.120004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_064ccd91385d4f7db985421d083e4b95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/064ccd91385d4f7db985421d083e4b95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/064ccd91385d4f7db985421d083e4b95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/064ccd91385d4f7db985421d083e4b95"}]}] Sep 15 19:26:35.120004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:35.120004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 064ccd91385d4f7db985421d083e4b95 Sep 15 19:26:35.120004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesNegativeTest-535499324 Sep 15 19:26:35.120004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesNegativeTest-535499324-project Sep 15 19:26:35.120004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:26:35.120004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:26:35.120004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 9823a946acd148f0baf138b53bc1edf7 Sep 15 19:26:35.120004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesNegativeTest-535499324-project Sep 15 19:26:35.120004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: Sep 15 19:26:35.120004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Volume 0669e2ad-ddfa-424f-99c5-0a2dc37c0669 could not be found. Sep 15 19:26:35.120004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '0669e2ad-ddfa-424f-99c5-0a2dc37c0669'} Sep 15 19:26:35.120004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0669e2ad-ddfa-424f-99c5-0a2dc37c0669 could not be found. (HTTP 404) (Request-ID: req-9307ae05-b652-452e-ae09-cbc58deb0249) Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:35.120609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 19:26:35.121450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0669e2ad-ddfa-424f-99c5-0a2dc37c0669 could not be found. Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 19:26:35.122280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0669e2ad-ddfa-424f-99c5-0a2dc37c0669 could not be found. Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0669e2ad-ddfa-424f-99c5-0a2dc37c0669 could not be found. Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-db96b26f-b6d7-4f02-a9b7-af02fab561c5 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] Returning 404 to user: Volume 0669e2ad-ddfa-424f-99c5-0a2dc37c0669 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-db96b26f-b6d7-4f02-a9b7-af02fab561c5 tempest-VolumesNegativeTest-535499324 tempest-VolumesNegativeTest-535499324-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/0669e2ad-ddfa-424f-99c5-0a2dc37c0669" status: 404 len: 109 microversion: 2.1 time: 0.249682 Sep 15 19:26:35.123107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 8/8] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:26:34 2022] GET /compute/v2.1/os-volumes/0669e2ad-ddfa-424f-99c5-0a2dc37c0669 => generated 109 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:26:35.625921 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f0995b71-a4f1-4574-b972-9e570b719be4 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.627688 Sep 15 19:26:35.627291 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1/9] 10.222.0.18 () {60 vars in 1156 bytes} [Thu Sep 15 19:26:30 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4631 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 15 19:26:35.643936 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-79314134-39d1-4c98-a630-f0f1856762c9 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] Calling method '.version_select at 0x7f551fa00040>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:36.015499 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-79314134-39d1-4c98-a630-f0f1856762c9 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d23d6d0d-4b84-4f46-beff-7946f14b4acd" status: 200 len: 352 microversion: 2.1 time: 0.376305 Sep 15 19:26:36.016424 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 9/10] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:26:35 2022] GET /compute/v2.1/os-volumes/d23d6d0d-4b84-4f46-beff-7946f14b4acd => generated 352 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:26:37.032722 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c46ac1d2-9d54-4f9b-88d0-d311d69bbb13 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] Calling method '.version_select at 0x7f551fa113a0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:37.179426 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c46ac1d2-9d54-4f9b-88d0-d311d69bbb13 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d23d6d0d-4b84-4f46-beff-7946f14b4acd" status: 200 len: 353 microversion: 2.1 time: 0.151805 Sep 15 19:26:37.182663 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2/11] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:26:37 2022] GET /compute/v2.1/os-volumes/d23d6d0d-4b84-4f46-beff-7946f14b4acd => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:26:37.195668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7278c2d5-ab63-416b-a219-552368539b4a tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] Calling method '.version_select at 0x7f551f92c9d0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:37.377513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7278c2d5-ab63-416b-a219-552368539b4a tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d23d6d0d-4b84-4f46-beff-7946f14b4acd" status: 200 len: 353 microversion: 2.1 time: 0.186579 Sep 15 19:26:37.378824 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 10/12] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:26:37 2022] GET /compute/v2.1/os-volumes/d23d6d0d-4b84-4f46-beff-7946f14b4acd => generated 353 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:26:37.404045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-891e6b09-cd97-4dc3-baec-214beb51c2f1 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] Calling method '.version_select at 0x7f551fa11a60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:37.811771 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-891e6b09-cd97-4dc3-baec-214beb51c2f1 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/d23d6d0d-4b84-4f46-beff-7946f14b4acd" status: 202 len: 0 microversion: 2.1 time: 0.418225 Sep 15 19:26:37.813091 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3/13] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 15 19:26:37 2022] DELETE /compute/v2.1/os-volumes/d23d6d0d-4b84-4f46-beff-7946f14b4acd => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:26:37.825724 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-88f9d183-13ff-4da0-9ffd-b0366cba1896 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] Calling method '.version_select at 0x7f551f92c280>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:38.019091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-88f9d183-13ff-4da0-9ffd-b0366cba1896 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d23d6d0d-4b84-4f46-beff-7946f14b4acd" status: 200 len: 352 microversion: 2.1 time: 0.201501 Sep 15 19:26:38.022390 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 11/14] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:26:37 2022] GET /compute/v2.1/os-volumes/d23d6d0d-4b84-4f46-beff-7946f14b4acd => generated 352 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:26:39.045279 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b9a03838-cd2e-4b7a-ab7f-2eb19f926e24 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] Calling method '.version_select at 0x7f551f9a7160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:39.121746 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-b9a03838-cd2e-4b7a-ab7f-2eb19f926e24 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] HTTP exception thrown: Volume d23d6d0d-4b84-4f46-beff-7946f14b4acd could not be found. Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b9a03838-cd2e-4b7a-ab7f-2eb19f926e24 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] Request method failure captured: Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/os-volumes/d23d6d0d-4b84-4f46-beff-7946f14b4acd HTTP/1.1 Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Connection: close Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Host: 10.222.0.18 Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjI3xmNr4Et-4VWD1p3iqUE8ACm1q99n84BSEReJp3S9UMhhbPu5I44ePB_hiJ3wwogVNcja41QTT6i5HWqyz7ke4ou8NYHvBx7PKqdt7jwidi3owL9DnPgaFMFwdj0KNXbN4866tT6v5-qW9i0hpZKCRA9CpGxRQeQib7QejZMNexXyE Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Id: ecc8dce537dd4fb2901ca3b2b62a5dc2 Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesGetTestJSON-1121191568 Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Role: member,reader Sep 15 19:26:39.127785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Roles: member,reader Sep 15 19:26:39.129029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ecc8dce537dd4fb2901ca3b2b62a5dc2", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ecc8dce537dd4fb2901ca3b2b62a5dc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ecc8dce537dd4fb2901ca3b2b62a5dc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ecc8dce537dd4fb2901ca3b2b62a5dc2"}]}] Sep 15 19:26:39.129029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-VolumesGetTestJSON-1121191568 Sep 15 19:26:39.129029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Id: ecc8dce537dd4fb2901ca3b2b62a5dc2 Sep 15 19:26:39.129029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesGetTestJSON-1121191568 Sep 15 19:26:39.129029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User: tempest-VolumesGetTestJSON-1121191568-project Sep 15 19:26:39.129029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 15 19:26:39.129029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 15 19:26:39.129029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Id: 121295939fc44468bd2b04ed47f45886 Sep 15 19:26:39.129029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-VolumesGetTestJSON-1121191568-project Sep 15 19:26:39.129029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: method: Sep 15 19:26:39.129029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: exception: Volume d23d6d0d-4b84-4f46-beff-7946f14b4acd could not be found. Sep 15 19:26:39.129029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: action_args: {'id': 'd23d6d0d-4b84-4f46-beff-7946f14b4acd'} Sep 15 19:26:39.129029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d23d6d0d-4b84-4f46-beff-7946f14b4acd could not be found. (HTTP 404) (Request-ID: req-8426f609-99a5-4a97-90c6-d3897bcaac13) Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:39.129772 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 19:26:39.130761 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d23d6d0d-4b84-4f46-beff-7946f14b4acd could not be found. Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 19:26:39.136567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d23d6d0d-4b84-4f46-beff-7946f14b4acd could not be found. Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d23d6d0d-4b84-4f46-beff-7946f14b4acd could not be found. Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b9a03838-cd2e-4b7a-ab7f-2eb19f926e24 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] Returning 404 to user: Volume d23d6d0d-4b84-4f46-beff-7946f14b4acd could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b9a03838-cd2e-4b7a-ab7f-2eb19f926e24 tempest-VolumesGetTestJSON-1121191568 tempest-VolumesGetTestJSON-1121191568-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d23d6d0d-4b84-4f46-beff-7946f14b4acd" status: 404 len: 109 microversion: 2.1 time: 0.096333 Sep 15 19:26:39.137737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4/15] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:26:39 2022] GET /compute/v2.1/os-volumes/d23d6d0d-4b84-4f46-beff-7946f14b4acd => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:26:41.976144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1034493625", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "networks": [{"uuid": "154bf27e-6b45-4c49-b369-66b1d881a8f5"}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:26:42.234194 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] validate_networks() for [('154bf27e-6b45-4c49-b369-66b1d881a8f5', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:26:44.619433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:26:44.620231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:26:44.621078 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:26:44.621718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:26:44.622363 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:26:44.667225 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:44.668146 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:44.668937 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:44.670309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:44.671151 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:44.671990 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:44.794490 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Getting quotas for project 4a866fb1264140c1a1056696bf6fabc7. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:26:44.803178 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Getting quotas for user 1ab4dbb6c98f4c99bbb06f586aaddeba and project 4a866fb1264140c1a1056696bf6fabc7. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:26:44.819581 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:26:44.824429 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:26:45.088746 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-82b2e0e8-d9cf-4eae-8672-527f8dacc702 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.372854 Sep 15 19:26:45.089499 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 12/16] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:26:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 19:26:45.102900 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af4b0c4a-503c-4d83-ae4a-5ee904634c2b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:45.103811 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af4b0c4a-503c-4d83-ae4a-5ee904634c2b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:45.409489 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-af4b0c4a-503c-4d83-ae4a-5ee904634c2b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:45.438663 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af4b0c4a-503c-4d83-ae4a-5ee904634c2b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1215 microversion: 2.1 time: 0.340561 Sep 15 19:26:45.460417 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 5/17] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:45 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1215 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:46.470536 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dd847bf7-8b89-4a85-8765-1f5b4ac096ba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:46.472093 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dd847bf7-8b89-4a85-8765-1f5b4ac096ba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:46.619578 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-dd847bf7-8b89-4a85-8765-1f5b4ac096ba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:46.634157 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dd847bf7-8b89-4a85-8765-1f5b4ac096ba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1215 microversion: 2.1 time: 0.169808 Sep 15 19:26:46.636771 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 6/18] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:46 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:46.788000 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-786344ca-4af0-4d50-ab20-a663faf54b96 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Action: 'create', calling method: .version_select at 0x7f551f92c310>, body: {"keypair": {"name": "tempest-keypair-453785919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpHWQ5Fw1NdmZ2/XViQkBHQL2MfEBRcR3OCcStaYM9z6sel4lUx4aYVITBzFguXKHd4B+x9LTLPlWcrKPC/FWIrZH37hjGREBLZnnualg8CGjhXh7y0ZJtAVPTw+qTU+g=="}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:26:46.904817 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-786344ca-4af0-4d50-ab20-a663faf54b96 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:26:46.916965 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-786344ca-4af0-4d50-ab20-a663faf54b96 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for user 0e37c8ca70ad4b6e8430a71d0f5e564f and project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:26:47.116476 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-786344ca-4af0-4d50-ab20-a663faf54b96 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.879525 Sep 15 19:26:47.116476 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 13/19] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 15 19:26:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:26:47.683911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4af1a350-8399-4ce6-b24d-6072937ca651 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:47.685468 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4af1a350-8399-4ce6-b24d-6072937ca651 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:47.896115 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4af1a350-8399-4ce6-b24d-6072937ca651 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:47.930135 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4af1a350-8399-4ce6-b24d-6072937ca651 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1215 microversion: 2.1 time: 0.230116 Sep 15 19:26:47.934871 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 7/20] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:47 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1215 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:48.836050 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1837338962", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:26:48.945189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] validate_networks() for [('f2ffb04b-7869-41f6-aad2-f6912ace930a', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:26:48.968795 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0843225-3bac-4774-86a6-dc9dab6edcdf tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:48.969440 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a0843225-3bac-4774-86a6-dc9dab6edcdf tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:49.012440 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0843225-3bac-4774-86a6-dc9dab6edcdf tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:49.019257 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0843225-3bac-4774-86a6-dc9dab6edcdf tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:49.019257 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0843225-3bac-4774-86a6-dc9dab6edcdf tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:49.019257 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0843225-3bac-4774-86a6-dc9dab6edcdf tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:49.019764 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0843225-3bac-4774-86a6-dc9dab6edcdf tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:49.020749 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0843225-3bac-4774-86a6-dc9dab6edcdf tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:49.540124 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0843225-3bac-4774-86a6-dc9dab6edcdf tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:49.572553 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0843225-3bac-4774-86a6-dc9dab6edcdf tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1219 microversion: 2.1 time: 0.614717 Sep 15 19:26:49.585846 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 8/21] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:48 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1219 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:49.711836 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:26:49.713387 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:26:49.714454 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:26:49.715501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:26:49.716564 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:26:49.732467 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:49.733319 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:49.734104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:49.739257 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:49.740761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:49.741509 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:49.824440 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Getting quotas for project 016f968319fd49d98506030c0bee6021. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:26:49.842674 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Getting quotas for user 1d7c40b5232e46119434aeeb8a6ad4d0 and project 016f968319fd49d98506030c0bee6021. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:26:49.883840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:26:49.892275 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:26:50.155797 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-820d1589-7f70-469c-a05e-006d2344dc9f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.115867 Sep 15 19:26:50.166488 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 14/22] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:26:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 19:26:50.172484 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-26e97234-0705-446a-b32e-3fdf5ae323f0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:50.174537 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-26e97234-0705-446a-b32e-3fdf5ae323f0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:50.378997 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-26e97234-0705-446a-b32e-3fdf5ae323f0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:50.390998 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-26e97234-0705-446a-b32e-3fdf5ae323f0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1222 microversion: 2.1 time: 0.222174 Sep 15 19:26:50.394463 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 9/23] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:50 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1222 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:50.613208 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-90b38467-0036-4c7c-a029-c2a7b00b069b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:50.613879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-90b38467-0036-4c7c-a029-c2a7b00b069b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:50.683248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90b38467-0036-4c7c-a029-c2a7b00b069b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:50.683862 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90b38467-0036-4c7c-a029-c2a7b00b069b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:50.684323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90b38467-0036-4c7c-a029-c2a7b00b069b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:50.685471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90b38467-0036-4c7c-a029-c2a7b00b069b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:50.685591 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90b38467-0036-4c7c-a029-c2a7b00b069b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:50.685935 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90b38467-0036-4c7c-a029-c2a7b00b069b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:50.820680 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2096406764", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:26:51.125836 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] validate_networks() for [('f2ffb04b-7869-41f6-aad2-f6912ace930a', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:26:51.158667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-90b38467-0036-4c7c-a029-c2a7b00b069b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:51.242210 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-90b38467-0036-4c7c-a029-c2a7b00b069b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1267 microversion: 2.1 time: 0.639546 Sep 15 19:26:51.249949 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 15/24] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:50 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1267 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:52.276866 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-545892c2-61de-4aa9-b413-1f74c12b7a40 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:52.282073 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-545892c2-61de-4aa9-b413-1f74c12b7a40 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:52.291021 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-545892c2-61de-4aa9-b413-1f74c12b7a40 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:52.292850 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-545892c2-61de-4aa9-b413-1f74c12b7a40 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:52.294234 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-545892c2-61de-4aa9-b413-1f74c12b7a40 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:52.296293 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-545892c2-61de-4aa9-b413-1f74c12b7a40 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:52.297063 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-545892c2-61de-4aa9-b413-1f74c12b7a40 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:52.297671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-545892c2-61de-4aa9-b413-1f74c12b7a40 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:52.405208 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-545892c2-61de-4aa9-b413-1f74c12b7a40 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:52.416231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-545892c2-61de-4aa9-b413-1f74c12b7a40 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1273 microversion: 2.1 time: 0.145760 Sep 15 19:26:52.463684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 16/25] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:52 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1273 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:53.486361 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e1880101-5383-4141-bbe3-f7307b3aa928 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:53.496210 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e1880101-5383-4141-bbe3-f7307b3aa928 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:53.510195 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1880101-5383-4141-bbe3-f7307b3aa928 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:53.514812 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1880101-5383-4141-bbe3-f7307b3aa928 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:53.519905 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1880101-5383-4141-bbe3-f7307b3aa928 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:53.519905 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1880101-5383-4141-bbe3-f7307b3aa928 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:53.519905 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1880101-5383-4141-bbe3-f7307b3aa928 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:53.519905 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1880101-5383-4141-bbe3-f7307b3aa928 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:53.837929 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e1880101-5383-4141-bbe3-f7307b3aa928 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:53.855681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e1880101-5383-4141-bbe3-f7307b3aa928 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1273 microversion: 2.1 time: 0.373931 Sep 15 19:26:53.856470 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 17/26] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:53 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1273 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:54.508556 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1922758880", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f608162d-6498-4eba-ac51-7e7b4de51e0d"}], "security_groups": [{"name": "tempest-securitygroup--1190478312"}], "key_name": "tempest-keypair-453785919", "user_data": "}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:26:54.864821 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] validate_networks() for [('f608162d-6498-4eba-ac51-7e7b4de51e0d', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:26:55.352196 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:26:55.352887 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:26:55.353083 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:26:55.353546 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:26:55.353979 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:26:55.399335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:55.399887 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:55.400348 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:55.402955 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:55.404809 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:55.405261 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:55.469564 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Getting quotas for project 016f968319fd49d98506030c0bee6021. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:26:55.479931 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Getting quotas for user 1d7c40b5232e46119434aeeb8a6ad4d0 and project 016f968319fd49d98506030c0bee6021. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:26:55.501242 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:26:55.504809 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:26:55.793669 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6fd9eccd-caf5-4ee3-bae5-004c2639f22f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.978990 Sep 15 19:26:55.794205 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 10/27] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:26:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 4980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 19:26:55.810138 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-82728abb-9ba2-462b-aabd-ee89e5a2204c tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:55.810771 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-82728abb-9ba2-462b-aabd-ee89e5a2204c tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:55.830317 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82728abb-9ba2-462b-aabd-ee89e5a2204c tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:55.831092 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82728abb-9ba2-462b-aabd-ee89e5a2204c tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:55.831726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82728abb-9ba2-462b-aabd-ee89e5a2204c tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:55.832605 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82728abb-9ba2-462b-aabd-ee89e5a2204c tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:55.833226 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82728abb-9ba2-462b-aabd-ee89e5a2204c tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:55.833834 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82728abb-9ba2-462b-aabd-ee89e5a2204c tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:55.884818 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:26:55.885389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:26:55.885892 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:26:55.886610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:26:55.887448 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:26:55.900764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:55.901622 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:55.902229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:55.903212 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:55.904692 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:55.905626 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:55.959741 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:26:55.976056 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for user 0e37c8ca70ad4b6e8430a71d0f5e564f and project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:26:56.038877 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:26:56.041847 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:26:56.248557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7b9f298c-3ac8-462d-a3d5-ad18ccbe726d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.745936 Sep 15 19:26:56.255408 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 18/28] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:26:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 19:26:56.280147 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-60902403-79de-4806-a70f-357fdd1696f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:56.291033 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-60902403-79de-4806-a70f-357fdd1696f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:56.589339 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-82728abb-9ba2-462b-aabd-ee89e5a2204c tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:56.601807 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-82728abb-9ba2-462b-aabd-ee89e5a2204c tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.795583 Sep 15 19:26:56.603666 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 11/29] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:55 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:56.617783 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-957a0f1e-c387-451b-949f-8093791bf30e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:56.617783 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-957a0f1e-c387-451b-949f-8093791bf30e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:56.698697 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-60902403-79de-4806-a70f-357fdd1696f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:56.741739 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-60902403-79de-4806-a70f-357fdd1696f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1222 microversion: 2.1 time: 0.486979 Sep 15 19:26:56.746810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 19/30] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:56 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1222 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:57.631912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f70d224a-5dc6-4a52-8b46-233131f20593 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:57.633453 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f70d224a-5dc6-4a52-8b46-233131f20593 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:57.645371 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f70d224a-5dc6-4a52-8b46-233131f20593 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:57.646745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f70d224a-5dc6-4a52-8b46-233131f20593 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:57.647417 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f70d224a-5dc6-4a52-8b46-233131f20593 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:57.648342 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f70d224a-5dc6-4a52-8b46-233131f20593 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:57.648976 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f70d224a-5dc6-4a52-8b46-233131f20593 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:57.649582 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f70d224a-5dc6-4a52-8b46-233131f20593 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:57.746752 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-957a0f1e-c387-451b-949f-8093791bf30e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:57.751096 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-957a0f1e-c387-451b-949f-8093791bf30e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1241 microversion: 2.1 time: 1.145738 Sep 15 19:26:57.751681 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 12/31] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:56 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1241 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:57.778803 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f867be01-38f0-48d8-872e-591ae32eaf20 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:57.796684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f867be01-38f0-48d8-872e-591ae32eaf20 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:57.811214 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f867be01-38f0-48d8-872e-591ae32eaf20 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:57.811911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f867be01-38f0-48d8-872e-591ae32eaf20 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:57.812543 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f867be01-38f0-48d8-872e-591ae32eaf20 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:57.813590 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f867be01-38f0-48d8-872e-591ae32eaf20 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:57.816344 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f867be01-38f0-48d8-872e-591ae32eaf20 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:57.817083 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f867be01-38f0-48d8-872e-591ae32eaf20 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:57.999689 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f867be01-38f0-48d8-872e-591ae32eaf20 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:58.013951 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f867be01-38f0-48d8-872e-591ae32eaf20 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1226 microversion: 2.1 time: 0.238910 Sep 15 19:26:58.014657 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 13/32] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:57 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1226 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:58.592491 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f70d224a-5dc6-4a52-8b46-233131f20593 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:58.609661 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f70d224a-5dc6-4a52-8b46-233131f20593 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.983023 Sep 15 19:26:58.610931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 20/33] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:57 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:58.780116 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9f7fd7fe-d1ec-4e20-b87f-33c9dea025b6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:58.781315 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9f7fd7fe-d1ec-4e20-b87f-33c9dea025b6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:58.789350 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f7fd7fe-d1ec-4e20-b87f-33c9dea025b6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:58.794528 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f7fd7fe-d1ec-4e20-b87f-33c9dea025b6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:58.794528 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f7fd7fe-d1ec-4e20-b87f-33c9dea025b6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:58.794528 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f7fd7fe-d1ec-4e20-b87f-33c9dea025b6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:58.794528 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f7fd7fe-d1ec-4e20-b87f-33c9dea025b6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:58.795177 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f7fd7fe-d1ec-4e20-b87f-33c9dea025b6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:58.939298 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9f7fd7fe-d1ec-4e20-b87f-33c9dea025b6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:58.951636 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9f7fd7fe-d1ec-4e20-b87f-33c9dea025b6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1245 microversion: 2.1 time: 0.175229 Sep 15 19:26:58.952839 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 14/34] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:58 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1245 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:59.050308 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-92bcbf50-74d6-48ea-a36f-a22518e50a7f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:59.051029 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-92bcbf50-74d6-48ea-a36f-a22518e50a7f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:59.063636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92bcbf50-74d6-48ea-a36f-a22518e50a7f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:59.064406 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92bcbf50-74d6-48ea-a36f-a22518e50a7f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:59.066761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92bcbf50-74d6-48ea-a36f-a22518e50a7f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:59.068438 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92bcbf50-74d6-48ea-a36f-a22518e50a7f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:59.072992 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92bcbf50-74d6-48ea-a36f-a22518e50a7f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:59.073637 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92bcbf50-74d6-48ea-a36f-a22518e50a7f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:59.362795 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-92bcbf50-74d6-48ea-a36f-a22518e50a7f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:26:59.370776 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-92bcbf50-74d6-48ea-a36f-a22518e50a7f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1218 microversion: 2.1 time: 0.331295 Sep 15 19:26:59.381767 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 21/35] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:59 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1218 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:26:59.645658 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a3735d8a-5d8d-4242-8072-6e1ad517f114 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:59.646801 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a3735d8a-5d8d-4242-8072-6e1ad517f114 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:26:59.668740 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3735d8a-5d8d-4242-8072-6e1ad517f114 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:59.669248 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3735d8a-5d8d-4242-8072-6e1ad517f114 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:59.669698 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3735d8a-5d8d-4242-8072-6e1ad517f114 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:59.670434 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3735d8a-5d8d-4242-8072-6e1ad517f114 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:26:59.670889 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3735d8a-5d8d-4242-8072-6e1ad517f114 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:26:59.671333 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3735d8a-5d8d-4242-8072-6e1ad517f114 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:26:59.984943 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7134770e-d11f-4165-ad08-fa58960f3eea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:26:59.992391 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7134770e-d11f-4165-ad08-fa58960f3eea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:00.008318 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7134770e-d11f-4165-ad08-fa58960f3eea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:00.009081 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7134770e-d11f-4165-ad08-fa58960f3eea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:00.009920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7134770e-d11f-4165-ad08-fa58960f3eea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:00.010725 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7134770e-d11f-4165-ad08-fa58960f3eea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:00.011238 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7134770e-d11f-4165-ad08-fa58960f3eea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:00.011758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7134770e-d11f-4165-ad08-fa58960f3eea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:00.038745 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a3735d8a-5d8d-4242-8072-6e1ad517f114 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:00.065768 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a3735d8a-5d8d-4242-8072-6e1ad517f114 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.432187 Sep 15 19:27:00.085649 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 15/36] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:59 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:00.192924 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7134770e-d11f-4165-ad08-fa58960f3eea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:00.204029 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7134770e-d11f-4165-ad08-fa58960f3eea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1245 microversion: 2.1 time: 0.224637 Sep 15 19:27:00.216421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 22/37] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:26:59 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1245 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:00.405471 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d874fde7-4ead-41ba-bc0d-d239a14cc0da tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:00.406233 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d874fde7-4ead-41ba-bc0d-d239a14cc0da tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:00.415072 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d874fde7-4ead-41ba-bc0d-d239a14cc0da tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:00.415627 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d874fde7-4ead-41ba-bc0d-d239a14cc0da tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:00.416465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d874fde7-4ead-41ba-bc0d-d239a14cc0da tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:00.417070 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d874fde7-4ead-41ba-bc0d-d239a14cc0da tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:00.417630 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d874fde7-4ead-41ba-bc0d-d239a14cc0da tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:00.418138 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d874fde7-4ead-41ba-bc0d-d239a14cc0da tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:00.595308 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d874fde7-4ead-41ba-bc0d-d239a14cc0da tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:00.609308 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d874fde7-4ead-41ba-bc0d-d239a14cc0da tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1218 microversion: 2.1 time: 0.207843 Sep 15 19:27:00.613574 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 16/38] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:00 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:01.100572 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6e287a72-bc40-4d4c-90a9-b3285ab75896 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:01.103572 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6e287a72-bc40-4d4c-90a9-b3285ab75896 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:01.125781 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e287a72-bc40-4d4c-90a9-b3285ab75896 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:01.132858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e287a72-bc40-4d4c-90a9-b3285ab75896 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:01.139092 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e287a72-bc40-4d4c-90a9-b3285ab75896 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:01.144572 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e287a72-bc40-4d4c-90a9-b3285ab75896 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:01.149574 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e287a72-bc40-4d4c-90a9-b3285ab75896 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:01.153716 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e287a72-bc40-4d4c-90a9-b3285ab75896 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:01.229352 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a37fb752-790f-4e0d-aab9-409087851277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:01.230088 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a37fb752-790f-4e0d-aab9-409087851277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:01.282149 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a37fb752-790f-4e0d-aab9-409087851277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:01.285487 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a37fb752-790f-4e0d-aab9-409087851277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:01.286122 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a37fb752-790f-4e0d-aab9-409087851277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:01.289821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a37fb752-790f-4e0d-aab9-409087851277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:01.300119 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a37fb752-790f-4e0d-aab9-409087851277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:01.308670 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a37fb752-790f-4e0d-aab9-409087851277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:01.551765 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a37fb752-790f-4e0d-aab9-409087851277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:01.560236 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a37fb752-790f-4e0d-aab9-409087851277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1245 microversion: 2.1 time: 0.334535 Sep 15 19:27:01.561419 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 17/39] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:01 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1245 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:01.623524 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6e287a72-bc40-4d4c-90a9-b3285ab75896 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:01.638045 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6e287a72-bc40-4d4c-90a9-b3285ab75896 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.544959 Sep 15 19:27:01.638632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 23/40] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:01 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:01.650858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c7b48535-3ec2-4a81-b8fd-9a7daa078600 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:01.651997 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c7b48535-3ec2-4a81-b8fd-9a7daa078600 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:01.660458 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7b48535-3ec2-4a81-b8fd-9a7daa078600 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:01.661226 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7b48535-3ec2-4a81-b8fd-9a7daa078600 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:01.663064 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7b48535-3ec2-4a81-b8fd-9a7daa078600 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:01.664638 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7b48535-3ec2-4a81-b8fd-9a7daa078600 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:01.665349 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7b48535-3ec2-4a81-b8fd-9a7daa078600 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:01.666397 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7b48535-3ec2-4a81-b8fd-9a7daa078600 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:01.815085 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c7b48535-3ec2-4a81-b8fd-9a7daa078600 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:01.836512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c7b48535-3ec2-4a81-b8fd-9a7daa078600 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1218 microversion: 2.1 time: 0.194857 Sep 15 19:27:01.836512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 24/41] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:01 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:01.880191 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-10fe67d9-1d5b-4a23-b243-f9359bb3ae34 req-f71acf2d-e1cc-418a-9ff8-ab0775d706dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ffe7b2-9cde-408a-b314-8c18c02ca8fb", "tag": "feb98b2b-660f-43d5-86f0-4251ddf907d1"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:27:01.900611 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-10fe67d9-1d5b-4a23-b243-f9359bb3ae34 req-f71acf2d-e1cc-418a-9ff8-ab0775d706dd service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:01.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-10fe67d9-1d5b-4a23-b243-f9359bb3ae34 req-f71acf2d-e1cc-418a-9ff8-ab0775d706dd service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:01.901842 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-10fe67d9-1d5b-4a23-b243-f9359bb3ae34 req-f71acf2d-e1cc-418a-9ff8-ab0775d706dd service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:01.933885 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-10fe67d9-1d5b-4a23-b243-f9359bb3ae34 req-f71acf2d-e1cc-418a-9ff8-ab0775d706dd service nova] Creating event network-changed:feb98b2b-660f-43d5-86f0-4251ddf907d1 for instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb on hv-cinder-84984 Sep 15 19:27:01.934576 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-10fe67d9-1d5b-4a23-b243-f9359bb3ae34 req-f71acf2d-e1cc-418a-9ff8-ab0775d706dd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 15 19:27:01.935476 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-10fe67d9-1d5b-4a23-b243-f9359bb3ae34 req-f71acf2d-e1cc-418a-9ff8-ab0775d706dd service nova] Acquired lock "compute-rpcapi-router" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 15 19:27:01.937556 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cfa71dd-34f8-43b1-9737-9a0918ed7d57 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:01.938211 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cfa71dd-34f8-43b1-9737-9a0918ed7d57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:01.939216 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cfa71dd-34f8-43b1-9737-9a0918ed7d57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:01.940219 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cfa71dd-34f8-43b1-9737-9a0918ed7d57 None None] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:01.940845 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cfa71dd-34f8-43b1-9737-9a0918ed7d57 None None] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:01.941320 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cfa71dd-34f8-43b1-9737-9a0918ed7d57 None None] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:01.951217 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.compute.rpcapi [None req-3cfa71dd-34f8-43b1-9737-9a0918ed7d57 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 15 19:27:01.952156 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cfa71dd-34f8-43b1-9737-9a0918ed7d57 None None] Releasing lock "compute-rpcapi-router" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 15 19:27:01.974962 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3cfa71dd-34f8-43b1-9737-9a0918ed7d57 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.409051 Sep 15 19:27:01.974962 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 18/42] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:27:02.588650 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-686a4551-6b7d-498a-84ef-b5419d7c4206 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:02.589645 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-686a4551-6b7d-498a-84ef-b5419d7c4206 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:02.598238 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-686a4551-6b7d-498a-84ef-b5419d7c4206 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:02.598882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-686a4551-6b7d-498a-84ef-b5419d7c4206 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:02.600111 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-686a4551-6b7d-498a-84ef-b5419d7c4206 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:02.600991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-686a4551-6b7d-498a-84ef-b5419d7c4206 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:02.601523 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-686a4551-6b7d-498a-84ef-b5419d7c4206 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:02.602045 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-686a4551-6b7d-498a-84ef-b5419d7c4206 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:02.673189 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c15708f9-5c88-4d8f-a300-dcb3171c2c88 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:02.673707 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c15708f9-5c88-4d8f-a300-dcb3171c2c88 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:02.681883 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15708f9-5c88-4d8f-a300-dcb3171c2c88 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:02.682520 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15708f9-5c88-4d8f-a300-dcb3171c2c88 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:02.683133 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15708f9-5c88-4d8f-a300-dcb3171c2c88 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:02.683897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15708f9-5c88-4d8f-a300-dcb3171c2c88 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:02.684563 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15708f9-5c88-4d8f-a300-dcb3171c2c88 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:02.684896 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15708f9-5c88-4d8f-a300-dcb3171c2c88 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:02.689699 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-686a4551-6b7d-498a-84ef-b5419d7c4206 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:02.702049 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-686a4551-6b7d-498a-84ef-b5419d7c4206 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1245 microversion: 2.1 time: 0.114630 Sep 15 19:27:02.702049 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 25/43] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:02 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1245 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:02.875227 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c15708f9-5c88-4d8f-a300-dcb3171c2c88 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:02.878772 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-13d545f3-3dd9-4313-b212-0dfadc629713 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:02.880074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-13d545f3-3dd9-4313-b212-0dfadc629713 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:02.889221 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c15708f9-5c88-4d8f-a300-dcb3171c2c88 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.221578 Sep 15 19:27:02.890463 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 19/44] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:02 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:02.893582 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13d545f3-3dd9-4313-b212-0dfadc629713 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:02.894493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13d545f3-3dd9-4313-b212-0dfadc629713 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:02.895212 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13d545f3-3dd9-4313-b212-0dfadc629713 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:02.897120 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13d545f3-3dd9-4313-b212-0dfadc629713 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:02.897779 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13d545f3-3dd9-4313-b212-0dfadc629713 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:02.898608 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13d545f3-3dd9-4313-b212-0dfadc629713 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:03.032746 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-13d545f3-3dd9-4313-b212-0dfadc629713 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:03.041508 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-13d545f3-3dd9-4313-b212-0dfadc629713 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1218 microversion: 2.1 time: 0.169870 Sep 15 19:27:03.042620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 26/45] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:02 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:03.724166 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6fbf9c80-d924-44f0-b723-dcdf1ed66f86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:03.725226 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6fbf9c80-d924-44f0-b723-dcdf1ed66f86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:03.737288 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fbf9c80-d924-44f0-b723-dcdf1ed66f86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:03.738037 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fbf9c80-d924-44f0-b723-dcdf1ed66f86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:03.738505 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fbf9c80-d924-44f0-b723-dcdf1ed66f86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:03.739318 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fbf9c80-d924-44f0-b723-dcdf1ed66f86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:03.740000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fbf9c80-d924-44f0-b723-dcdf1ed66f86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:03.740584 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fbf9c80-d924-44f0-b723-dcdf1ed66f86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:03.869985 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6fbf9c80-d924-44f0-b723-dcdf1ed66f86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:03.885756 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6fbf9c80-d924-44f0-b723-dcdf1ed66f86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1245 microversion: 2.1 time: 0.166740 Sep 15 19:27:03.887577 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 20/46] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:03 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1245 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:03.941326 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-17be4bd5-1022-44bf-a380-e2d59beeff60 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:03.944803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-17be4bd5-1022-44bf-a380-e2d59beeff60 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:03.957748 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-17be4bd5-1022-44bf-a380-e2d59beeff60 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:03.968546 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-17be4bd5-1022-44bf-a380-e2d59beeff60 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:03.971681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-17be4bd5-1022-44bf-a380-e2d59beeff60 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:03.976205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-17be4bd5-1022-44bf-a380-e2d59beeff60 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:03.976689 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-17be4bd5-1022-44bf-a380-e2d59beeff60 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:03.977133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-17be4bd5-1022-44bf-a380-e2d59beeff60 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:04.071853 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a805c3b9-5e07-485f-8756-ff56b24b9f05 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:04.072876 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a805c3b9-5e07-485f-8756-ff56b24b9f05 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:04.086102 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a805c3b9-5e07-485f-8756-ff56b24b9f05 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:04.086984 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a805c3b9-5e07-485f-8756-ff56b24b9f05 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:04.087757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a805c3b9-5e07-485f-8756-ff56b24b9f05 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:04.088662 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a805c3b9-5e07-485f-8756-ff56b24b9f05 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:04.089668 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a805c3b9-5e07-485f-8756-ff56b24b9f05 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:04.090259 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a805c3b9-5e07-485f-8756-ff56b24b9f05 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:04.226486 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a805c3b9-5e07-485f-8756-ff56b24b9f05 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:04.235786 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a805c3b9-5e07-485f-8756-ff56b24b9f05 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1218 microversion: 2.1 time: 0.168068 Sep 15 19:27:04.236667 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 21/47] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:04 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:04.273580 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-17be4bd5-1022-44bf-a380-e2d59beeff60 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:04.289264 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-17be4bd5-1022-44bf-a380-e2d59beeff60 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.359187 Sep 15 19:27:04.292961 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 27/48] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:03 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:04.934140 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-86ec8d0e-0efa-456b-8578-9456464c7017 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:04.938708 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-86ec8d0e-0efa-456b-8578-9456464c7017 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:04.961559 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86ec8d0e-0efa-456b-8578-9456464c7017 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:04.962639 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86ec8d0e-0efa-456b-8578-9456464c7017 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:04.964279 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86ec8d0e-0efa-456b-8578-9456464c7017 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:04.965803 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86ec8d0e-0efa-456b-8578-9456464c7017 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:04.967508 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86ec8d0e-0efa-456b-8578-9456464c7017 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:04.968550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86ec8d0e-0efa-456b-8578-9456464c7017 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:05.129208 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-86ec8d0e-0efa-456b-8578-9456464c7017 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:05.150385 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-86ec8d0e-0efa-456b-8578-9456464c7017 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1245 microversion: 2.1 time: 0.223937 Sep 15 19:27:05.152037 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 22/49] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:04 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1245 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:05.260355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6dea1859-c01e-40dd-90c6-838275b19f91 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:05.261075 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6dea1859-c01e-40dd-90c6-838275b19f91 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:05.289053 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6dea1859-c01e-40dd-90c6-838275b19f91 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:05.289053 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6dea1859-c01e-40dd-90c6-838275b19f91 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:05.289053 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6dea1859-c01e-40dd-90c6-838275b19f91 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:05.289053 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6dea1859-c01e-40dd-90c6-838275b19f91 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:05.289726 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6dea1859-c01e-40dd-90c6-838275b19f91 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:05.289726 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6dea1859-c01e-40dd-90c6-838275b19f91 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:05.315257 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a33ea912-22be-44a9-9254-3f69d1f8bd6d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:05.315933 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a33ea912-22be-44a9-9254-3f69d1f8bd6d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:05.341189 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a33ea912-22be-44a9-9254-3f69d1f8bd6d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:05.344296 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a33ea912-22be-44a9-9254-3f69d1f8bd6d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:05.344975 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a33ea912-22be-44a9-9254-3f69d1f8bd6d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:05.352110 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a33ea912-22be-44a9-9254-3f69d1f8bd6d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:05.354234 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a33ea912-22be-44a9-9254-3f69d1f8bd6d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:05.356131 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a33ea912-22be-44a9-9254-3f69d1f8bd6d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:05.527798 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6dea1859-c01e-40dd-90c6-838275b19f91 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:05.541519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6dea1859-c01e-40dd-90c6-838275b19f91 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1218 microversion: 2.1 time: 0.286395 Sep 15 19:27:05.542774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 28/50] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:05 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1218 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:06.076149 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a33ea912-22be-44a9-9254-3f69d1f8bd6d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:06.089695 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a33ea912-22be-44a9-9254-3f69d1f8bd6d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.778400 Sep 15 19:27:06.090630 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 23/51] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:05 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:06.190085 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-eabbee87-3fe4-47e4-8e89-ad55a450f655 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:06.193583 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-eabbee87-3fe4-47e4-8e89-ad55a450f655 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:06.193837 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=6 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:06.208087 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eabbee87-3fe4-47e4-8e89-ad55a450f655 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:06.210658 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eabbee87-3fe4-47e4-8e89-ad55a450f655 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:06.213664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eabbee87-3fe4-47e4-8e89-ad55a450f655 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:06.216054 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eabbee87-3fe4-47e4-8e89-ad55a450f655 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:06.216054 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eabbee87-3fe4-47e4-8e89-ad55a450f655 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:06.216054 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eabbee87-3fe4-47e4-8e89-ad55a450f655 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:06.487382 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-eabbee87-3fe4-47e4-8e89-ad55a450f655 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:06.498527 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-eabbee87-3fe4-47e4-8e89-ad55a450f655 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1237 microversion: 2.1 time: 0.313550 Sep 15 19:27:06.499388 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 29/52] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:06 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1237 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:06.575605 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b22d954f-f5b3-492f-a0e2-d62962ed8bc0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:06.580655 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b22d954f-f5b3-492f-a0e2-d62962ed8bc0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:06.640173 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b22d954f-f5b3-492f-a0e2-d62962ed8bc0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:06.640895 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b22d954f-f5b3-492f-a0e2-d62962ed8bc0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:06.641518 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b22d954f-f5b3-492f-a0e2-d62962ed8bc0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:06.643366 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b22d954f-f5b3-492f-a0e2-d62962ed8bc0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:06.644372 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b22d954f-f5b3-492f-a0e2-d62962ed8bc0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:06.645091 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b22d954f-f5b3-492f-a0e2-d62962ed8bc0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:06.941480 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b22d954f-f5b3-492f-a0e2-d62962ed8bc0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:06.992034 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b22d954f-f5b3-492f-a0e2-d62962ed8bc0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1274 microversion: 2.1 time: 0.425448 Sep 15 19:27:06.999137 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 24/53] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:06 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1274 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:07.144573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8eaa8bab-b3eb-4cca-b46d-08665dea3b23 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:07.145460 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8eaa8bab-b3eb-4cca-b46d-08665dea3b23 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:07.148681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=24 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:07.156546 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8eaa8bab-b3eb-4cca-b46d-08665dea3b23 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:07.157199 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8eaa8bab-b3eb-4cca-b46d-08665dea3b23 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:07.157972 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8eaa8bab-b3eb-4cca-b46d-08665dea3b23 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:07.158938 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8eaa8bab-b3eb-4cca-b46d-08665dea3b23 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:07.159580 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8eaa8bab-b3eb-4cca-b46d-08665dea3b23 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:07.160471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8eaa8bab-b3eb-4cca-b46d-08665dea3b23 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:07.451058 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8eaa8bab-b3eb-4cca-b46d-08665dea3b23 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:07.464406 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8eaa8bab-b3eb-4cca-b46d-08665dea3b23 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.324126 Sep 15 19:27:07.465314 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 30/54] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:07 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:07.545971 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7a7c93b-e171-473b-9ac1-f2467a8091aa tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:07.546961 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7a7c93b-e171-473b-9ac1-f2467a8091aa tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:07.559494 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7a7c93b-e171-473b-9ac1-f2467a8091aa tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:07.561867 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7a7c93b-e171-473b-9ac1-f2467a8091aa tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:07.563482 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7a7c93b-e171-473b-9ac1-f2467a8091aa tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:07.564831 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7a7c93b-e171-473b-9ac1-f2467a8091aa tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:07.565653 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7a7c93b-e171-473b-9ac1-f2467a8091aa tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:07.566712 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7a7c93b-e171-473b-9ac1-f2467a8091aa tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:07.739482 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e7a7c93b-e171-473b-9ac1-f2467a8091aa tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:07.752725 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=16 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:07.757097 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7a7c93b-e171-473b-9ac1-f2467a8091aa tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1293 microversion: 2.1 time: 0.217805 Sep 15 19:27:07.757683 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 25/55] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:07 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1293 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:07.878396 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-811957aa-3327-4b96-b73f-328236980c4a req-9d349077-f226-4d7b-9ebf-b0592527701a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b36131f-5f27-419f-b1b2-da2d6ebc60e5", "tag": "df8bdaca-d337-4c5a-a11c-dbedba1578a8"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:27:07.901780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-811957aa-3327-4b96-b73f-328236980c4a req-9d349077-f226-4d7b-9ebf-b0592527701a service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:07.902174 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-811957aa-3327-4b96-b73f-328236980c4a req-9d349077-f226-4d7b-9ebf-b0592527701a service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:07.902613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-811957aa-3327-4b96-b73f-328236980c4a req-9d349077-f226-4d7b-9ebf-b0592527701a service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:07.941377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-811957aa-3327-4b96-b73f-328236980c4a req-9d349077-f226-4d7b-9ebf-b0592527701a service nova] Creating event network-changed:df8bdaca-d337-4c5a-a11c-dbedba1578a8 for instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 on hv-cinder-84984 Sep 15 19:27:07.941764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-811957aa-3327-4b96-b73f-328236980c4a req-9d349077-f226-4d7b-9ebf-b0592527701a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 15 19:27:07.942158 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-811957aa-3327-4b96-b73f-328236980c4a req-9d349077-f226-4d7b-9ebf-b0592527701a service nova] Acquired lock "compute-rpcapi-router" {{(pid=121041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 15 19:27:07.943964 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e040761-b221-45af-b45f-1d72852f6d02 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:07.944424 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e040761-b221-45af-b45f-1d72852f6d02 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:07.944862 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e040761-b221-45af-b45f-1d72852f6d02 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:07.945587 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e040761-b221-45af-b45f-1d72852f6d02 None None] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:07.946041 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e040761-b221-45af-b45f-1d72852f6d02 None None] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:07.946464 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e040761-b221-45af-b45f-1d72852f6d02 None None] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:07.957181 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.compute.rpcapi [None req-5e040761-b221-45af-b45f-1d72852f6d02 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 15 19:27:07.960930 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e040761-b221-45af-b45f-1d72852f6d02 None None] Releasing lock "compute-rpcapi-router" {{(pid=121041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 15 19:27:07.986754 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5e040761-b221-45af-b45f-1d72852f6d02 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175422 Sep 15 19:27:07.987359 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 31/56] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:27:08.016009 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ac4c5918-9fcc-44a3-a17b-20f835b3c718 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:08.016615 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ac4c5918-9fcc-44a3-a17b-20f835b3c718 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:08.023177 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac4c5918-9fcc-44a3-a17b-20f835b3c718 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:08.023947 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac4c5918-9fcc-44a3-a17b-20f835b3c718 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:08.024760 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac4c5918-9fcc-44a3-a17b-20f835b3c718 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:08.025719 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac4c5918-9fcc-44a3-a17b-20f835b3c718 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:08.026179 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac4c5918-9fcc-44a3-a17b-20f835b3c718 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:08.026606 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac4c5918-9fcc-44a3-a17b-20f835b3c718 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:08.111445 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ac4c5918-9fcc-44a3-a17b-20f835b3c718 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:08.131407 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ac4c5918-9fcc-44a3-a17b-20f835b3c718 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1282 microversion: 2.1 time: 0.119315 Sep 15 19:27:08.132498 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 26/57] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:08 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:08.494659 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6f62a278-0e7c-4635-9f3b-3aadef11496b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:08.495930 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6f62a278-0e7c-4635-9f3b-3aadef11496b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:08.506738 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6f62a278-0e7c-4635-9f3b-3aadef11496b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:08.507589 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6f62a278-0e7c-4635-9f3b-3aadef11496b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:08.508361 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6f62a278-0e7c-4635-9f3b-3aadef11496b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:08.509553 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6f62a278-0e7c-4635-9f3b-3aadef11496b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:08.524610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6f62a278-0e7c-4635-9f3b-3aadef11496b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:08.524610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6f62a278-0e7c-4635-9f3b-3aadef11496b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:08.685057 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6f62a278-0e7c-4635-9f3b-3aadef11496b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:08.702638 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:08.707336 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6f62a278-0e7c-4635-9f3b-3aadef11496b tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.221321 Sep 15 19:27:08.708957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 32/58] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:08 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:08.784855 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-53a03137-5b3f-43d2-9569-45a9105d14df tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:08.786003 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-53a03137-5b3f-43d2-9569-45a9105d14df tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:08.800126 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53a03137-5b3f-43d2-9569-45a9105d14df tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:08.801647 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53a03137-5b3f-43d2-9569-45a9105d14df tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:08.802701 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53a03137-5b3f-43d2-9569-45a9105d14df tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:08.803632 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53a03137-5b3f-43d2-9569-45a9105d14df tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:08.804532 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53a03137-5b3f-43d2-9569-45a9105d14df tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:08.805165 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53a03137-5b3f-43d2-9569-45a9105d14df tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:08.837316 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:08.884386 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-53a03137-5b3f-43d2-9569-45a9105d14df tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:08.892089 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-53a03137-5b3f-43d2-9569-45a9105d14df tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1293 microversion: 2.1 time: 0.114992 Sep 15 19:27:08.892646 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 27/59] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:08 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:09.164303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-87c6cd10-9a74-47b2-8f8a-af32275995eb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:09.164303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-87c6cd10-9a74-47b2-8f8a-af32275995eb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:09.172723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:09.175112 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87c6cd10-9a74-47b2-8f8a-af32275995eb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:09.175807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87c6cd10-9a74-47b2-8f8a-af32275995eb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:09.176383 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87c6cd10-9a74-47b2-8f8a-af32275995eb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:09.186686 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87c6cd10-9a74-47b2-8f8a-af32275995eb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:09.186686 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87c6cd10-9a74-47b2-8f8a-af32275995eb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:09.186686 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87c6cd10-9a74-47b2-8f8a-af32275995eb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:09.269075 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-87c6cd10-9a74-47b2-8f8a-af32275995eb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:09.280525 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-87c6cd10-9a74-47b2-8f8a-af32275995eb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1282 microversion: 2.1 time: 0.123463 Sep 15 19:27:09.280525 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 33/60] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:09 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1282 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:09.732956 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5fa53a22-db03-40e5-8d89-6f25c4c9f635 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:09.733645 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5fa53a22-db03-40e5-8d89-6f25c4c9f635 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:09.755246 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fa53a22-db03-40e5-8d89-6f25c4c9f635 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:09.757267 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fa53a22-db03-40e5-8d89-6f25c4c9f635 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:09.758016 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fa53a22-db03-40e5-8d89-6f25c4c9f635 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:09.760253 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fa53a22-db03-40e5-8d89-6f25c4c9f635 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:09.761130 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fa53a22-db03-40e5-8d89-6f25c4c9f635 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:09.763894 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fa53a22-db03-40e5-8d89-6f25c4c9f635 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:09.922033 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-95a78284-85a8-433b-b1e6-389472bf4acb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:09.923775 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-95a78284-85a8-433b-b1e6-389472bf4acb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:09.934374 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-95a78284-85a8-433b-b1e6-389472bf4acb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:09.939537 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-95a78284-85a8-433b-b1e6-389472bf4acb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:09.940569 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-95a78284-85a8-433b-b1e6-389472bf4acb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:09.941891 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-95a78284-85a8-433b-b1e6-389472bf4acb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:09.943039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-95a78284-85a8-433b-b1e6-389472bf4acb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:09.943941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-95a78284-85a8-433b-b1e6-389472bf4acb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:09.975314 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5fa53a22-db03-40e5-8d89-6f25c4c9f635 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:10.001294 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5fa53a22-db03-40e5-8d89-6f25c4c9f635 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.271562 Sep 15 19:27:10.004612 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 28/61] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:09 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:10.090759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-95a78284-85a8-433b-b1e6-389472bf4acb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:10.111260 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-95a78284-85a8-433b-b1e6-389472bf4acb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1293 microversion: 2.1 time: 0.195642 Sep 15 19:27:10.112803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 34/62] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:09 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1293 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:10.306702 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-67b23806-556c-4688-bc92-5c842ce790f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:10.309681 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-67b23806-556c-4688-bc92-5c842ce790f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:10.321326 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67b23806-556c-4688-bc92-5c842ce790f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:10.322262 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67b23806-556c-4688-bc92-5c842ce790f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:10.323261 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67b23806-556c-4688-bc92-5c842ce790f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:10.324546 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67b23806-556c-4688-bc92-5c842ce790f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:10.325392 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67b23806-556c-4688-bc92-5c842ce790f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:10.326433 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67b23806-556c-4688-bc92-5c842ce790f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:10.435538 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-67b23806-556c-4688-bc92-5c842ce790f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:10.446759 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-67b23806-556c-4688-bc92-5c842ce790f7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1282 microversion: 2.1 time: 0.147805 Sep 15 19:27:10.448849 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 29/63] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:10 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1282 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:11.042151 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c726b6a3-1fed-411b-a026-3cafdd9cba43 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:11.048434 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c726b6a3-1fed-411b-a026-3cafdd9cba43 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:11.084133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c726b6a3-1fed-411b-a026-3cafdd9cba43 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:11.085396 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c726b6a3-1fed-411b-a026-3cafdd9cba43 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:11.086482 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c726b6a3-1fed-411b-a026-3cafdd9cba43 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:11.087730 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c726b6a3-1fed-411b-a026-3cafdd9cba43 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:11.088705 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c726b6a3-1fed-411b-a026-3cafdd9cba43 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:11.089744 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c726b6a3-1fed-411b-a026-3cafdd9cba43 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:11.141951 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0fcb8921-3508-4d49-97d6-6a39341dea86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:11.150004 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0fcb8921-3508-4d49-97d6-6a39341dea86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:11.163474 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fcb8921-3508-4d49-97d6-6a39341dea86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:11.168153 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fcb8921-3508-4d49-97d6-6a39341dea86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:11.168829 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fcb8921-3508-4d49-97d6-6a39341dea86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:11.169857 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fcb8921-3508-4d49-97d6-6a39341dea86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:11.170340 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fcb8921-3508-4d49-97d6-6a39341dea86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:11.170876 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fcb8921-3508-4d49-97d6-6a39341dea86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:11.331057 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0fcb8921-3508-4d49-97d6-6a39341dea86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:11.344858 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0fcb8921-3508-4d49-97d6-6a39341dea86 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1293 microversion: 2.1 time: 0.211950 Sep 15 19:27:11.345702 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 30/64] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:11 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1293 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:11.473566 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dfd6842b-9b58-41cc-8dc6-d41e33ccbdc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:11.474149 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dfd6842b-9b58-41cc-8dc6-d41e33ccbdc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:11.491458 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd6842b-9b58-41cc-8dc6-d41e33ccbdc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:11.491996 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd6842b-9b58-41cc-8dc6-d41e33ccbdc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:11.524855 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd6842b-9b58-41cc-8dc6-d41e33ccbdc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:11.531284 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd6842b-9b58-41cc-8dc6-d41e33ccbdc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:11.532710 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd6842b-9b58-41cc-8dc6-d41e33ccbdc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:11.536316 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd6842b-9b58-41cc-8dc6-d41e33ccbdc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:11.839896 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-dfd6842b-9b58-41cc-8dc6-d41e33ccbdc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:11.848690 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dfd6842b-9b58-41cc-8dc6-d41e33ccbdc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1282 microversion: 2.1 time: 0.379383 Sep 15 19:27:11.857011 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 31/65] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:11 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1282 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:11.864209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c726b6a3-1fed-411b-a026-3cafdd9cba43 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:11.882494 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c726b6a3-1fed-411b-a026-3cafdd9cba43 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.855657 Sep 15 19:27:11.907779 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 35/66] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:11 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:12.394429 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-79c96860-1b37-4f72-b080-301335aeab65 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:12.395625 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-79c96860-1b37-4f72-b080-301335aeab65 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:12.445621 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:12.453251 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79c96860-1b37-4f72-b080-301335aeab65 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:12.456589 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79c96860-1b37-4f72-b080-301335aeab65 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:12.457299 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79c96860-1b37-4f72-b080-301335aeab65 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:12.460349 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79c96860-1b37-4f72-b080-301335aeab65 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:12.460814 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79c96860-1b37-4f72-b080-301335aeab65 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:12.461319 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79c96860-1b37-4f72-b080-301335aeab65 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:12.893598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c97d94de-3d1c-41d5-bcf0-caf3dac57ed9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:12.895165 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c97d94de-3d1c-41d5-bcf0-caf3dac57ed9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:12.904191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c97d94de-3d1c-41d5-bcf0-caf3dac57ed9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:12.905453 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c97d94de-3d1c-41d5-bcf0-caf3dac57ed9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:12.906120 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c97d94de-3d1c-41d5-bcf0-caf3dac57ed9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:12.917529 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c97d94de-3d1c-41d5-bcf0-caf3dac57ed9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:12.918821 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c97d94de-3d1c-41d5-bcf0-caf3dac57ed9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:12.919891 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c97d94de-3d1c-41d5-bcf0-caf3dac57ed9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:13.043135 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-79c96860-1b37-4f72-b080-301335aeab65 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:13.077787 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-79c96860-1b37-4f72-b080-301335aeab65 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1301 microversion: 2.1 time: 0.687735 Sep 15 19:27:13.080189 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 32/67] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:12 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1301 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:13.105174 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-46c559bc-506b-4b1b-be92-3a0d4d8ccf26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:13.107237 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-46c559bc-506b-4b1b-be92-3a0d4d8ccf26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:13.119311 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46c559bc-506b-4b1b-be92-3a0d4d8ccf26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:13.121241 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46c559bc-506b-4b1b-be92-3a0d4d8ccf26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:13.121873 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46c559bc-506b-4b1b-be92-3a0d4d8ccf26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:13.123589 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46c559bc-506b-4b1b-be92-3a0d4d8ccf26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:13.124225 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46c559bc-506b-4b1b-be92-3a0d4d8ccf26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:13.125777 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46c559bc-506b-4b1b-be92-3a0d4d8ccf26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:13.269586 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c97d94de-3d1c-41d5-bcf0-caf3dac57ed9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:13.278572 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c97d94de-3d1c-41d5-bcf0-caf3dac57ed9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1280 microversion: 2.1 time: 0.389185 Sep 15 19:27:13.279810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 36/68] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:12 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1280 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:13.724351 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-46c559bc-506b-4b1b-be92-3a0d4d8ccf26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:13.765515 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-46c559bc-506b-4b1b-be92-3a0d4d8ccf26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.682463 Sep 15 19:27:13.776990 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 33/69] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:13 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:14.115457 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-80aa4d7a-1713-47c1-abfa-a42947a8cdbc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:14.116538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-80aa4d7a-1713-47c1-abfa-a42947a8cdbc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:14.127274 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80aa4d7a-1713-47c1-abfa-a42947a8cdbc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:14.131853 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80aa4d7a-1713-47c1-abfa-a42947a8cdbc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:14.140525 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80aa4d7a-1713-47c1-abfa-a42947a8cdbc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:14.140525 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80aa4d7a-1713-47c1-abfa-a42947a8cdbc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:14.145199 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80aa4d7a-1713-47c1-abfa-a42947a8cdbc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:14.146984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80aa4d7a-1713-47c1-abfa-a42947a8cdbc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:14.397988 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-230027ca-d2ea-432c-8dde-d8b23d2581c5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:14.397988 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-230027ca-d2ea-432c-8dde-d8b23d2581c5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:14.397988 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-230027ca-d2ea-432c-8dde-d8b23d2581c5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:14.397988 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-230027ca-d2ea-432c-8dde-d8b23d2581c5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:14.399396 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-230027ca-d2ea-432c-8dde-d8b23d2581c5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:14.399396 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-230027ca-d2ea-432c-8dde-d8b23d2581c5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:14.399396 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-230027ca-d2ea-432c-8dde-d8b23d2581c5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:14.399396 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-230027ca-d2ea-432c-8dde-d8b23d2581c5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:14.401175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-80aa4d7a-1713-47c1-abfa-a42947a8cdbc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:14.402216 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-80aa4d7a-1713-47c1-abfa-a42947a8cdbc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1299 microversion: 2.1 time: 0.293839 Sep 15 19:27:14.416225 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 37/70] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:14 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1299 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:14.487974 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-230027ca-d2ea-432c-8dde-d8b23d2581c5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:14.496776 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-230027ca-d2ea-432c-8dde-d8b23d2581c5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1280 microversion: 2.1 time: 0.190871 Sep 15 19:27:14.497402 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 34/71] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:14 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1280 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:14.825050 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8aab5a35-694a-4adf-b7be-31b21dc45dfc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:14.825667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8aab5a35-694a-4adf-b7be-31b21dc45dfc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:14.832748 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8aab5a35-694a-4adf-b7be-31b21dc45dfc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:14.834025 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8aab5a35-694a-4adf-b7be-31b21dc45dfc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:14.834228 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8aab5a35-694a-4adf-b7be-31b21dc45dfc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:14.835099 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8aab5a35-694a-4adf-b7be-31b21dc45dfc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:14.835550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8aab5a35-694a-4adf-b7be-31b21dc45dfc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:14.836011 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8aab5a35-694a-4adf-b7be-31b21dc45dfc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:15.304975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8aab5a35-694a-4adf-b7be-31b21dc45dfc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:15.315112 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8aab5a35-694a-4adf-b7be-31b21dc45dfc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.493821 Sep 15 19:27:15.315861 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 38/72] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:14 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:15.441541 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3276f1d0-2803-4ffc-9c53-adc27b9d1b46 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:15.442618 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3276f1d0-2803-4ffc-9c53-adc27b9d1b46 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:15.446731 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:15.452273 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3276f1d0-2803-4ffc-9c53-adc27b9d1b46 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:15.453034 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3276f1d0-2803-4ffc-9c53-adc27b9d1b46 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:15.453979 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3276f1d0-2803-4ffc-9c53-adc27b9d1b46 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:15.454957 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3276f1d0-2803-4ffc-9c53-adc27b9d1b46 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:15.455615 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3276f1d0-2803-4ffc-9c53-adc27b9d1b46 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:15.456189 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3276f1d0-2803-4ffc-9c53-adc27b9d1b46 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:15.535525 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0ba7705f-5ed6-491d-97f0-68bd84286fc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:15.538150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0ba7705f-5ed6-491d-97f0-68bd84286fc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:15.551247 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ba7705f-5ed6-491d-97f0-68bd84286fc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:15.552706 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ba7705f-5ed6-491d-97f0-68bd84286fc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:15.553752 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ba7705f-5ed6-491d-97f0-68bd84286fc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:15.555563 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ba7705f-5ed6-491d-97f0-68bd84286fc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:15.556393 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ba7705f-5ed6-491d-97f0-68bd84286fc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:15.557201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ba7705f-5ed6-491d-97f0-68bd84286fc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:15.747996 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0ba7705f-5ed6-491d-97f0-68bd84286fc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:15.765738 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0ba7705f-5ed6-491d-97f0-68bd84286fc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.239803 Sep 15 19:27:15.766789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 39/73] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:15 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:15.821922 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3276f1d0-2803-4ffc-9c53-adc27b9d1b46 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:15.832876 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3276f1d0-2803-4ffc-9c53-adc27b9d1b46 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.397156 Sep 15 19:27:15.844474 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 35/74] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:15 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:16.348191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7ef16601-7114-464c-bfe5-12012005f7c9 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:16.349287 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7ef16601-7114-464c-bfe5-12012005f7c9 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:16.363686 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ef16601-7114-464c-bfe5-12012005f7c9 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:16.365168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ef16601-7114-464c-bfe5-12012005f7c9 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:16.366159 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ef16601-7114-464c-bfe5-12012005f7c9 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:16.367982 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ef16601-7114-464c-bfe5-12012005f7c9 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:16.369615 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ef16601-7114-464c-bfe5-12012005f7c9 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:16.370533 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ef16601-7114-464c-bfe5-12012005f7c9 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:16.571083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7ef16601-7114-464c-bfe5-12012005f7c9 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:16.578757 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7ef16601-7114-464c-bfe5-12012005f7c9 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.238842 Sep 15 19:27:16.579318 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 40/75] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:16 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:16.790341 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eea7cb79-a45a-47e6-8b61-c417e938e7bc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:16.791134 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eea7cb79-a45a-47e6-8b61-c417e938e7bc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:16.797778 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eea7cb79-a45a-47e6-8b61-c417e938e7bc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:16.798261 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eea7cb79-a45a-47e6-8b61-c417e938e7bc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:16.798699 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eea7cb79-a45a-47e6-8b61-c417e938e7bc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:16.799399 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eea7cb79-a45a-47e6-8b61-c417e938e7bc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:16.799881 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eea7cb79-a45a-47e6-8b61-c417e938e7bc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:16.806881 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eea7cb79-a45a-47e6-8b61-c417e938e7bc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:16.865801 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-314f53bd-1913-4c39-86fe-6b7e7b36cb7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:16.866353 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-314f53bd-1913-4c39-86fe-6b7e7b36cb7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:16.873197 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-314f53bd-1913-4c39-86fe-6b7e7b36cb7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:16.874126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-314f53bd-1913-4c39-86fe-6b7e7b36cb7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:16.874796 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-314f53bd-1913-4c39-86fe-6b7e7b36cb7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:16.875910 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-314f53bd-1913-4c39-86fe-6b7e7b36cb7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:16.876665 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-314f53bd-1913-4c39-86fe-6b7e7b36cb7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:16.877094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-314f53bd-1913-4c39-86fe-6b7e7b36cb7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:17.015070 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-eea7cb79-a45a-47e6-8b61-c417e938e7bc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:17.029956 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eea7cb79-a45a-47e6-8b61-c417e938e7bc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.242278 Sep 15 19:27:17.040441 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 36/76] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:16 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:17.098508 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-314f53bd-1913-4c39-86fe-6b7e7b36cb7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:17.108622 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-314f53bd-1913-4c39-86fe-6b7e7b36cb7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.252077 Sep 15 19:27:17.112550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 41/77] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:16 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:17.609951 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7f9d718-fcf7-4e36-992a-b24ac1c2a5bc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:17.611747 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7f9d718-fcf7-4e36-992a-b24ac1c2a5bc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:17.626050 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f9d718-fcf7-4e36-992a-b24ac1c2a5bc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:17.627067 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f9d718-fcf7-4e36-992a-b24ac1c2a5bc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:17.628067 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f9d718-fcf7-4e36-992a-b24ac1c2a5bc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:17.629303 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f9d718-fcf7-4e36-992a-b24ac1c2a5bc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:17.630115 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f9d718-fcf7-4e36-992a-b24ac1c2a5bc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:17.630843 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f9d718-fcf7-4e36-992a-b24ac1c2a5bc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:17.935151 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e7f9d718-fcf7-4e36-992a-b24ac1c2a5bc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:17.945200 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7f9d718-fcf7-4e36-992a-b24ac1c2a5bc tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.343745 Sep 15 19:27:17.956328 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 37/78] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:17 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:18.078074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-35c8110c-ea07-455c-8766-43171db49325 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:18.083972 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-35c8110c-ea07-455c-8766-43171db49325 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:18.092239 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:18.094342 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35c8110c-ea07-455c-8766-43171db49325 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:18.095076 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35c8110c-ea07-455c-8766-43171db49325 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:18.108840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35c8110c-ea07-455c-8766-43171db49325 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:18.120992 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35c8110c-ea07-455c-8766-43171db49325 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:18.126628 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35c8110c-ea07-455c-8766-43171db49325 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:18.127128 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35c8110c-ea07-455c-8766-43171db49325 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:18.138540 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9bb885a2-2415-4239-98ef-dd7fb3a36e1c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:18.139441 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9bb885a2-2415-4239-98ef-dd7fb3a36e1c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:18.149734 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bb885a2-2415-4239-98ef-dd7fb3a36e1c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:18.151048 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bb885a2-2415-4239-98ef-dd7fb3a36e1c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:18.152443 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bb885a2-2415-4239-98ef-dd7fb3a36e1c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:18.154767 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bb885a2-2415-4239-98ef-dd7fb3a36e1c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:18.155962 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bb885a2-2415-4239-98ef-dd7fb3a36e1c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:18.156812 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bb885a2-2415-4239-98ef-dd7fb3a36e1c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:18.391975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-35c8110c-ea07-455c-8766-43171db49325 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:18.394249 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9bb885a2-2415-4239-98ef-dd7fb3a36e1c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:18.403259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-35c8110c-ea07-455c-8766-43171db49325 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.336295 Sep 15 19:27:18.403890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 42/79] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:18 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:18.405473 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9bb885a2-2415-4239-98ef-dd7fb3a36e1c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.273653 Sep 15 19:27:18.406460 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 38/80] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:18 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:18.970104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0eb9fd7a-fa25-43ab-b551-981199787ada tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:18.970848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0eb9fd7a-fa25-43ab-b551-981199787ada tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:18.981372 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0eb9fd7a-fa25-43ab-b551-981199787ada tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:18.981989 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0eb9fd7a-fa25-43ab-b551-981199787ada tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:18.982537 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0eb9fd7a-fa25-43ab-b551-981199787ada tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:18.983432 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0eb9fd7a-fa25-43ab-b551-981199787ada tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:18.984027 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0eb9fd7a-fa25-43ab-b551-981199787ada tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:18.984885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0eb9fd7a-fa25-43ab-b551-981199787ada tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:19.278495 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0eb9fd7a-fa25-43ab-b551-981199787ada tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:19.286508 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0eb9fd7a-fa25-43ab-b551-981199787ada tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.320611 Sep 15 19:27:19.287094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 43/81] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:18 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:19.459675 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5fc51ee-dbc7-4cc7-bbae-8058ea0c36e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:19.461562 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-49e037b3-50d8-4fe8-a55f-10bc12d77deb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:19.462781 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b5fc51ee-dbc7-4cc7-bbae-8058ea0c36e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:19.463721 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-49e037b3-50d8-4fe8-a55f-10bc12d77deb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:19.487942 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5fc51ee-dbc7-4cc7-bbae-8058ea0c36e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:19.488971 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5fc51ee-dbc7-4cc7-bbae-8058ea0c36e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:19.489282 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49e037b3-50d8-4fe8-a55f-10bc12d77deb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:19.491536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49e037b3-50d8-4fe8-a55f-10bc12d77deb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:19.492030 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5fc51ee-dbc7-4cc7-bbae-8058ea0c36e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:19.493418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49e037b3-50d8-4fe8-a55f-10bc12d77deb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:19.494379 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5fc51ee-dbc7-4cc7-bbae-8058ea0c36e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:19.495594 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49e037b3-50d8-4fe8-a55f-10bc12d77deb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:19.496429 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5fc51ee-dbc7-4cc7-bbae-8058ea0c36e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:19.498069 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5fc51ee-dbc7-4cc7-bbae-8058ea0c36e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:19.498611 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49e037b3-50d8-4fe8-a55f-10bc12d77deb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:19.500121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49e037b3-50d8-4fe8-a55f-10bc12d77deb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:19.811299 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5fc51ee-dbc7-4cc7-bbae-8058ea0c36e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:19.824432 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b5fc51ee-dbc7-4cc7-bbae-8058ea0c36e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.391146 Sep 15 19:27:19.825454 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 39/82] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:19 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:19.988878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-49e037b3-50d8-4fe8-a55f-10bc12d77deb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:19.999401 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-49e037b3-50d8-4fe8-a55f-10bc12d77deb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.565732 Sep 15 19:27:20.000124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 44/83] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:19 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:20.322434 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa5f8ac8-9e00-4b49-8120-289f17b00cba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:20.323043 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa5f8ac8-9e00-4b49-8120-289f17b00cba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:20.330912 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa5f8ac8-9e00-4b49-8120-289f17b00cba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:20.331419 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa5f8ac8-9e00-4b49-8120-289f17b00cba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:20.331906 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa5f8ac8-9e00-4b49-8120-289f17b00cba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:20.332691 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa5f8ac8-9e00-4b49-8120-289f17b00cba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:20.333171 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa5f8ac8-9e00-4b49-8120-289f17b00cba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:20.333594 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa5f8ac8-9e00-4b49-8120-289f17b00cba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:20.495513 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fa5f8ac8-9e00-4b49-8120-289f17b00cba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:20.506241 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa5f8ac8-9e00-4b49-8120-289f17b00cba tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.187686 Sep 15 19:27:20.506822 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 40/84] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:20 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:20.863335 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-46b81aa1-b4fb-4a73-aa37-73b3a2e34590 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:20.864575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-46b81aa1-b4fb-4a73-aa37-73b3a2e34590 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:20.885579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46b81aa1-b4fb-4a73-aa37-73b3a2e34590 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:20.886554 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46b81aa1-b4fb-4a73-aa37-73b3a2e34590 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:20.887252 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46b81aa1-b4fb-4a73-aa37-73b3a2e34590 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:20.888539 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46b81aa1-b4fb-4a73-aa37-73b3a2e34590 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:20.889374 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46b81aa1-b4fb-4a73-aa37-73b3a2e34590 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:20.890151 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46b81aa1-b4fb-4a73-aa37-73b3a2e34590 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:21.034469 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bb51a47e-f482-46cd-a1d3-2975c252a5b4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:21.035218 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bb51a47e-f482-46cd-a1d3-2975c252a5b4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:21.058687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb51a47e-f482-46cd-a1d3-2975c252a5b4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:21.061930 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb51a47e-f482-46cd-a1d3-2975c252a5b4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:21.061930 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb51a47e-f482-46cd-a1d3-2975c252a5b4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:21.061930 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb51a47e-f482-46cd-a1d3-2975c252a5b4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:21.061930 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb51a47e-f482-46cd-a1d3-2975c252a5b4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:21.062361 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb51a47e-f482-46cd-a1d3-2975c252a5b4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:21.277314 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bb51a47e-f482-46cd-a1d3-2975c252a5b4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:21.288063 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bb51a47e-f482-46cd-a1d3-2975c252a5b4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.258426 Sep 15 19:27:21.301538 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 41/85] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:21 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:21.401758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-46b81aa1-b4fb-4a73-aa37-73b3a2e34590 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:21.414283 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-46b81aa1-b4fb-4a73-aa37-73b3a2e34590 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.560360 Sep 15 19:27:21.415377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 45/86] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:20 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:21.546401 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8a709e50-376f-4817-ba3d-f2d7647921e0 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:21.547714 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8a709e50-376f-4817-ba3d-f2d7647921e0 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:21.557577 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a709e50-376f-4817-ba3d-f2d7647921e0 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:21.558280 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a709e50-376f-4817-ba3d-f2d7647921e0 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:21.559422 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a709e50-376f-4817-ba3d-f2d7647921e0 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:21.561010 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a709e50-376f-4817-ba3d-f2d7647921e0 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:21.561782 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a709e50-376f-4817-ba3d-f2d7647921e0 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:21.562389 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a709e50-376f-4817-ba3d-f2d7647921e0 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:21.924502 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-e8275723-bbe1-49e7-8c60-005c24c20476 req-5c10080c-9617-4162-a098-133822fe416a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3532b103-32ed-4f98-988c-acdaaca65fa8", "tag": "b92511d9-07c9-4977-aff4-3a688548dc81"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:27:21.951700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e8275723-bbe1-49e7-8c60-005c24c20476 req-5c10080c-9617-4162-a098-133822fe416a service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:21.954491 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e8275723-bbe1-49e7-8c60-005c24c20476 req-5c10080c-9617-4162-a098-133822fe416a service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:21.955052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e8275723-bbe1-49e7-8c60-005c24c20476 req-5c10080c-9617-4162-a098-133822fe416a service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:21.976558 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-e8275723-bbe1-49e7-8c60-005c24c20476 req-5c10080c-9617-4162-a098-133822fe416a service nova] Creating event network-changed:b92511d9-07c9-4977-aff4-3a688548dc81 for instance 3532b103-32ed-4f98-988c-acdaaca65fa8 on hv-cinder-84984 Sep 15 19:27:21.984125 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-e8275723-bbe1-49e7-8c60-005c24c20476 req-5c10080c-9617-4162-a098-133822fe416a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063775 Sep 15 19:27:21.987239 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 46/87] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:27:22.076678 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8a709e50-376f-4817-ba3d-f2d7647921e0 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:22.119999 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8a709e50-376f-4817-ba3d-f2d7647921e0 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.590678 Sep 15 19:27:22.121073 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 42/88] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:21 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:22.319770 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-14dfecaf-59e6-40f6-a95a-5f207658a02f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:22.322698 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-14dfecaf-59e6-40f6-a95a-5f207658a02f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:22.338429 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14dfecaf-59e6-40f6-a95a-5f207658a02f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:22.339459 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14dfecaf-59e6-40f6-a95a-5f207658a02f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:22.340904 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14dfecaf-59e6-40f6-a95a-5f207658a02f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:22.341597 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14dfecaf-59e6-40f6-a95a-5f207658a02f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:22.343113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14dfecaf-59e6-40f6-a95a-5f207658a02f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:22.343812 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14dfecaf-59e6-40f6-a95a-5f207658a02f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:22.449055 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8614d852-611e-4383-b75b-d9c21e42b48c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:22.450019 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8614d852-611e-4383-b75b-d9c21e42b48c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:22.461676 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8614d852-611e-4383-b75b-d9c21e42b48c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:22.462316 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8614d852-611e-4383-b75b-d9c21e42b48c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:22.462861 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8614d852-611e-4383-b75b-d9c21e42b48c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:22.463721 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8614d852-611e-4383-b75b-d9c21e42b48c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:22.465073 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8614d852-611e-4383-b75b-d9c21e42b48c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:22.465770 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8614d852-611e-4383-b75b-d9c21e42b48c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:22.866327 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8614d852-611e-4383-b75b-d9c21e42b48c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:22.887720 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8614d852-611e-4383-b75b-d9c21e42b48c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.448801 Sep 15 19:27:22.890400 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 43/89] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:22 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:23.030241 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-14dfecaf-59e6-40f6-a95a-5f207658a02f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:23.048383 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-14dfecaf-59e6-40f6-a95a-5f207658a02f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.738137 Sep 15 19:27:23.049273 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 47/90] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:22 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:23.152939 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dfeaa8c9-0dc2-4137-802d-14dffe1ef9af tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:23.153821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dfeaa8c9-0dc2-4137-802d-14dffe1ef9af tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:23.161941 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfeaa8c9-0dc2-4137-802d-14dffe1ef9af tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:23.162955 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfeaa8c9-0dc2-4137-802d-14dffe1ef9af tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:23.163589 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfeaa8c9-0dc2-4137-802d-14dffe1ef9af tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:23.166122 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfeaa8c9-0dc2-4137-802d-14dffe1ef9af tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:23.166825 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfeaa8c9-0dc2-4137-802d-14dffe1ef9af tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:23.167480 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfeaa8c9-0dc2-4137-802d-14dffe1ef9af tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:23.176078 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:23.385226 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-dfeaa8c9-0dc2-4137-802d-14dffe1ef9af tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:23.396376 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dfeaa8c9-0dc2-4137-802d-14dffe1ef9af tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.248407 Sep 15 19:27:23.396901 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 44/91] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:23 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:23.916345 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-87353535-61ef-4fe5-aa72-73e77a7c0564 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:23.917242 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-87353535-61ef-4fe5-aa72-73e77a7c0564 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:23.924696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87353535-61ef-4fe5-aa72-73e77a7c0564 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:23.925507 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87353535-61ef-4fe5-aa72-73e77a7c0564 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:23.926299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87353535-61ef-4fe5-aa72-73e77a7c0564 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:23.927309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87353535-61ef-4fe5-aa72-73e77a7c0564 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:23.928143 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87353535-61ef-4fe5-aa72-73e77a7c0564 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:23.928757 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87353535-61ef-4fe5-aa72-73e77a7c0564 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:24.045027 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-92218f43-0166-4f5b-a388-bd1d62ad5d8d req-81bb2d6b-c78e-456f-8bec-0c6151f9f4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced2825e-adc0-4716-88f5-0b0b297b2b21", "tag": "b8d23106-0153-4b20-8a66-916ff52a223e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:27:24.072586 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-92218f43-0166-4f5b-a388-bd1d62ad5d8d req-81bb2d6b-c78e-456f-8bec-0c6151f9f4dc service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:24.078581 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-92218f43-0166-4f5b-a388-bd1d62ad5d8d req-81bb2d6b-c78e-456f-8bec-0c6151f9f4dc service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:24.078581 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-92218f43-0166-4f5b-a388-bd1d62ad5d8d req-81bb2d6b-c78e-456f-8bec-0c6151f9f4dc service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:24.114448 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-92218f43-0166-4f5b-a388-bd1d62ad5d8d req-81bb2d6b-c78e-456f-8bec-0c6151f9f4dc service nova] Creating event network-changed:b8d23106-0153-4b20-8a66-916ff52a223e for instance ced2825e-adc0-4716-88f5-0b0b297b2b21 on hv-cinder-84984 Sep 15 19:27:24.131209 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-92218f43-0166-4f5b-a388-bd1d62ad5d8d req-81bb2d6b-c78e-456f-8bec-0c6151f9f4dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091724 Sep 15 19:27:24.134110 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 45/92] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:27:24.149449 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-09d65587-38db-4514-96bd-5733a3f1e50e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:24.151174 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-09d65587-38db-4514-96bd-5733a3f1e50e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:24.164934 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09d65587-38db-4514-96bd-5733a3f1e50e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:24.165965 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09d65587-38db-4514-96bd-5733a3f1e50e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:24.170568 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09d65587-38db-4514-96bd-5733a3f1e50e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:24.172338 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09d65587-38db-4514-96bd-5733a3f1e50e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:24.172484 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-87353535-61ef-4fe5-aa72-73e77a7c0564 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:24.179944 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09d65587-38db-4514-96bd-5733a3f1e50e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:24.181065 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09d65587-38db-4514-96bd-5733a3f1e50e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:24.191282 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-87353535-61ef-4fe5-aa72-73e77a7c0564 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.283677 Sep 15 19:27:24.194169 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 48/93] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:23 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:24.369131 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-09d65587-38db-4514-96bd-5733a3f1e50e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:24.382807 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-09d65587-38db-4514-96bd-5733a3f1e50e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.245446 Sep 15 19:27:24.384637 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 46/94] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:24 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:24.424663 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a33eb20b-ff51-4fc6-bd13-e0b1ad0a85ef tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:24.425699 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a33eb20b-ff51-4fc6-bd13-e0b1ad0a85ef tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:24.435510 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a33eb20b-ff51-4fc6-bd13-e0b1ad0a85ef tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:24.436275 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a33eb20b-ff51-4fc6-bd13-e0b1ad0a85ef tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:24.436884 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a33eb20b-ff51-4fc6-bd13-e0b1ad0a85ef tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:24.438070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a33eb20b-ff51-4fc6-bd13-e0b1ad0a85ef tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:24.438820 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a33eb20b-ff51-4fc6-bd13-e0b1ad0a85ef tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:24.439494 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a33eb20b-ff51-4fc6-bd13-e0b1ad0a85ef tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:24.671992 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a33eb20b-ff51-4fc6-bd13-e0b1ad0a85ef tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:24.684021 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a33eb20b-ff51-4fc6-bd13-e0b1ad0a85ef tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.265587 Sep 15 19:27:24.696449 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 49/95] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:24 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:25.225493 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5feb706-ad2c-48c8-bceb-f58b4612ee89 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:25.227710 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b5feb706-ad2c-48c8-bceb-f58b4612ee89 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:25.239710 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5feb706-ad2c-48c8-bceb-f58b4612ee89 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:25.240442 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5feb706-ad2c-48c8-bceb-f58b4612ee89 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:25.241157 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5feb706-ad2c-48c8-bceb-f58b4612ee89 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:25.241916 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5feb706-ad2c-48c8-bceb-f58b4612ee89 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:25.242658 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5feb706-ad2c-48c8-bceb-f58b4612ee89 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:25.243312 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5feb706-ad2c-48c8-bceb-f58b4612ee89 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:25.406423 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-350437a3-eee3-4f07-8e1c-a667efa13b1c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:25.406981 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-350437a3-eee3-4f07-8e1c-a667efa13b1c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:25.413477 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-350437a3-eee3-4f07-8e1c-a667efa13b1c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:25.413976 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-350437a3-eee3-4f07-8e1c-a667efa13b1c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:25.414410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-350437a3-eee3-4f07-8e1c-a667efa13b1c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:25.417740 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5feb706-ad2c-48c8-bceb-f58b4612ee89 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:25.421658 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-350437a3-eee3-4f07-8e1c-a667efa13b1c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:25.422230 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-350437a3-eee3-4f07-8e1c-a667efa13b1c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:25.422719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-350437a3-eee3-4f07-8e1c-a667efa13b1c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:25.425781 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b5feb706-ad2c-48c8-bceb-f58b4612ee89 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.210454 Sep 15 19:27:25.426377 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 47/96] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:25 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:25.434959 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:25.593331 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-350437a3-eee3-4f07-8e1c-a667efa13b1c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:25.605379 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-350437a3-eee3-4f07-8e1c-a667efa13b1c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.202476 Sep 15 19:27:25.607823 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 50/97] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:25 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:25.722644 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e88feec8-1f07-41a5-88b8-ec5dbaa820ed tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:25.725372 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e88feec8-1f07-41a5-88b8-ec5dbaa820ed tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:25.742539 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e88feec8-1f07-41a5-88b8-ec5dbaa820ed tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:25.744759 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e88feec8-1f07-41a5-88b8-ec5dbaa820ed tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:25.753431 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e88feec8-1f07-41a5-88b8-ec5dbaa820ed tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:25.756887 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e88feec8-1f07-41a5-88b8-ec5dbaa820ed tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:25.758434 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e88feec8-1f07-41a5-88b8-ec5dbaa820ed tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:25.759546 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e88feec8-1f07-41a5-88b8-ec5dbaa820ed tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:25.975100 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e88feec8-1f07-41a5-88b8-ec5dbaa820ed tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:25.987781 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e88feec8-1f07-41a5-88b8-ec5dbaa820ed tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.277030 Sep 15 19:27:25.988572 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 48/98] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:25 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:26.451293 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-48e24f73-abee-4c12-887e-baee01fbef28 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:26.456036 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-48e24f73-abee-4c12-887e-baee01fbef28 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:26.464379 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-48e24f73-abee-4c12-887e-baee01fbef28 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:26.464901 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-48e24f73-abee-4c12-887e-baee01fbef28 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:26.465351 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-48e24f73-abee-4c12-887e-baee01fbef28 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:26.466055 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-48e24f73-abee-4c12-887e-baee01fbef28 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:26.466539 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-48e24f73-abee-4c12-887e-baee01fbef28 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:26.466988 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-48e24f73-abee-4c12-887e-baee01fbef28 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:26.633508 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72497142-1ea5-4ed2-8250-7ab47f95cd49 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:26.635096 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-72497142-1ea5-4ed2-8250-7ab47f95cd49 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:26.646080 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72497142-1ea5-4ed2-8250-7ab47f95cd49 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:26.646080 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72497142-1ea5-4ed2-8250-7ab47f95cd49 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:26.646080 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72497142-1ea5-4ed2-8250-7ab47f95cd49 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:26.646080 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72497142-1ea5-4ed2-8250-7ab47f95cd49 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:26.646555 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72497142-1ea5-4ed2-8250-7ab47f95cd49 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:26.647301 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72497142-1ea5-4ed2-8250-7ab47f95cd49 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:26.809227 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-48e24f73-abee-4c12-887e-baee01fbef28 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:26.820807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-48e24f73-abee-4c12-887e-baee01fbef28 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.373565 Sep 15 19:27:26.822578 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 51/99] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:26 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:26.928848 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-72497142-1ea5-4ed2-8250-7ab47f95cd49 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:26.949003 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-72497142-1ea5-4ed2-8250-7ab47f95cd49 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.320517 Sep 15 19:27:26.950519 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 49/100] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:26 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:27.025088 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-53a3e88c-bf2a-4acf-9ea7-5fba93569e69 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:27.028360 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-53a3e88c-bf2a-4acf-9ea7-5fba93569e69 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:27.062448 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53a3e88c-bf2a-4acf-9ea7-5fba93569e69 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:27.063457 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53a3e88c-bf2a-4acf-9ea7-5fba93569e69 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:27.066890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53a3e88c-bf2a-4acf-9ea7-5fba93569e69 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:27.079329 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53a3e88c-bf2a-4acf-9ea7-5fba93569e69 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:27.079329 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53a3e88c-bf2a-4acf-9ea7-5fba93569e69 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:27.079329 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53a3e88c-bf2a-4acf-9ea7-5fba93569e69 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:27.340211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-53a3e88c-bf2a-4acf-9ea7-5fba93569e69 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:27.353365 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-53a3e88c-bf2a-4acf-9ea7-5fba93569e69 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.337125 Sep 15 19:27:27.354336 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 52/101] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:27 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:27.857910 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-45c21faf-b043-45d7-a3f7-93fdb2477d3f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:27.859208 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-45c21faf-b043-45d7-a3f7-93fdb2477d3f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:27.866774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45c21faf-b043-45d7-a3f7-93fdb2477d3f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:27.867275 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45c21faf-b043-45d7-a3f7-93fdb2477d3f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:27.867770 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45c21faf-b043-45d7-a3f7-93fdb2477d3f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:27.868492 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45c21faf-b043-45d7-a3f7-93fdb2477d3f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:27.868970 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45c21faf-b043-45d7-a3f7-93fdb2477d3f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:27.869395 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45c21faf-b043-45d7-a3f7-93fdb2477d3f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:28.276745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-45c21faf-b043-45d7-a3f7-93fdb2477d3f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:28.287398 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-45c21faf-b043-45d7-a3f7-93fdb2477d3f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.434006 Sep 15 19:27:28.288537 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 53/102] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:27 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:28.299573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dabb79d7-bf4f-4fdc-adfa-372daf337ca8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:28.300790 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-dabb79d7-bf4f-4fdc-adfa-372daf337ca8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:28.313453 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dabb79d7-bf4f-4fdc-adfa-372daf337ca8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:28.314431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dabb79d7-bf4f-4fdc-adfa-372daf337ca8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:28.315456 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dabb79d7-bf4f-4fdc-adfa-372daf337ca8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:28.316940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dabb79d7-bf4f-4fdc-adfa-372daf337ca8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:28.318419 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dabb79d7-bf4f-4fdc-adfa-372daf337ca8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:28.319204 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dabb79d7-bf4f-4fdc-adfa-372daf337ca8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:28.842551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dabb79d7-bf4f-4fdc-adfa-372daf337ca8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:28.893055 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dabb79d7-bf4f-4fdc-adfa-372daf337ca8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.587344 Sep 15 19:27:28.913751 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 54/103] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:28 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:28.928153 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e8625cdd-b71e-4f19-a330-2fa1a753ba8d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:28.930545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e8625cdd-b71e-4f19-a330-2fa1a753ba8d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:28.950125 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8625cdd-b71e-4f19-a330-2fa1a753ba8d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:28.951201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8625cdd-b71e-4f19-a330-2fa1a753ba8d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:28.952163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8625cdd-b71e-4f19-a330-2fa1a753ba8d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:28.953588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8625cdd-b71e-4f19-a330-2fa1a753ba8d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:28.957393 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8625cdd-b71e-4f19-a330-2fa1a753ba8d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:28.957393 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8625cdd-b71e-4f19-a330-2fa1a753ba8d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:29.019692 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b945e447-9197-4a17-86c9-2e2a63a01953 req-2829131e-8a4c-4162-bd13-bbe3855c0c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ffe7b2-9cde-408a-b314-8c18c02ca8fb", "name": "network-vif-plugged", "status": "completed", "tag": "feb98b2b-660f-43d5-86f0-4251ddf907d1"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:27:29.042879 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b945e447-9197-4a17-86c9-2e2a63a01953 req-2829131e-8a4c-4162-bd13-bbe3855c0c1c service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:29.043472 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b945e447-9197-4a17-86c9-2e2a63a01953 req-2829131e-8a4c-4162-bd13-bbe3855c0c1c service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:29.045580 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b945e447-9197-4a17-86c9-2e2a63a01953 req-2829131e-8a4c-4162-bd13-bbe3855c0c1c service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:29.087446 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b945e447-9197-4a17-86c9-2e2a63a01953 req-2829131e-8a4c-4162-bd13-bbe3855c0c1c service nova] Creating event network-vif-plugged:feb98b2b-660f-43d5-86f0-4251ddf907d1 for instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb on hv-cinder-84984 Sep 15 19:27:29.145927 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b945e447-9197-4a17-86c9-2e2a63a01953 req-2829131e-8a4c-4162-bd13-bbe3855c0c1c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.484702 Sep 15 19:27:29.148217 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 50/104] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:27:29.264690 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e8625cdd-b71e-4f19-a330-2fa1a753ba8d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:29.290870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e8625cdd-b71e-4f19-a330-2fa1a753ba8d tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.375203 Sep 15 19:27:29.295269 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 55/105] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:28 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:29.339130 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc191f6d-e8e4-4223-83a0-f9aabcd9c6b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:29.339799 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bc191f6d-e8e4-4223-83a0-f9aabcd9c6b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:29.347448 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc191f6d-e8e4-4223-83a0-f9aabcd9c6b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:29.347966 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc191f6d-e8e4-4223-83a0-f9aabcd9c6b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:29.348925 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc191f6d-e8e4-4223-83a0-f9aabcd9c6b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:29.349837 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc191f6d-e8e4-4223-83a0-f9aabcd9c6b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:29.350454 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc191f6d-e8e4-4223-83a0-f9aabcd9c6b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:29.351042 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc191f6d-e8e4-4223-83a0-f9aabcd9c6b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:29.551231 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc191f6d-e8e4-4223-83a0-f9aabcd9c6b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:29.565104 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc191f6d-e8e4-4223-83a0-f9aabcd9c6b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.231523 Sep 15 19:27:29.566676 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 51/106] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:29 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:29.922047 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3ffa8479-0e4f-4105-ab3f-72152782525d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:29.941009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3ffa8479-0e4f-4105-ab3f-72152782525d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:29.961744 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ffa8479-0e4f-4105-ab3f-72152782525d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:29.970464 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ffa8479-0e4f-4105-ab3f-72152782525d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:29.971560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ffa8479-0e4f-4105-ab3f-72152782525d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:29.973091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ffa8479-0e4f-4105-ab3f-72152782525d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:29.974170 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ffa8479-0e4f-4105-ab3f-72152782525d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:29.975142 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ffa8479-0e4f-4105-ab3f-72152782525d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:30.223872 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3ffa8479-0e4f-4105-ab3f-72152782525d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:30.233068 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3ffa8479-0e4f-4105-ab3f-72152782525d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.327026 Sep 15 19:27:30.234266 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 56/107] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:29 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:30.327105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddb292ac-0ead-4360-ba8d-170eae79bb30 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:30.327760 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ddb292ac-0ead-4360-ba8d-170eae79bb30 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:30.337946 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddb292ac-0ead-4360-ba8d-170eae79bb30 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:30.338439 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddb292ac-0ead-4360-ba8d-170eae79bb30 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:30.343580 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddb292ac-0ead-4360-ba8d-170eae79bb30 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:30.344388 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddb292ac-0ead-4360-ba8d-170eae79bb30 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:30.344867 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddb292ac-0ead-4360-ba8d-170eae79bb30 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:30.345316 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddb292ac-0ead-4360-ba8d-170eae79bb30 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:30.492663 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ddb292ac-0ead-4360-ba8d-170eae79bb30 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:30.501005 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ddb292ac-0ead-4360-ba8d-170eae79bb30 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.178724 Sep 15 19:27:30.508755 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 52/108] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:30 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:30.590855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8347f34a-368c-4afb-8ece-add17ff21b85 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:30.591771 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8347f34a-368c-4afb-8ece-add17ff21b85 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:30.597897 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8347f34a-368c-4afb-8ece-add17ff21b85 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:30.599010 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8347f34a-368c-4afb-8ece-add17ff21b85 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:30.599604 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8347f34a-368c-4afb-8ece-add17ff21b85 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:30.600551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8347f34a-368c-4afb-8ece-add17ff21b85 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:30.601224 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8347f34a-368c-4afb-8ece-add17ff21b85 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:30.601738 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8347f34a-368c-4afb-8ece-add17ff21b85 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:30.784547 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8347f34a-368c-4afb-8ece-add17ff21b85 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:30.799615 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8347f34a-368c-4afb-8ece-add17ff21b85 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.213261 Sep 15 19:27:30.800310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 57/109] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:30 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:31.165914 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f7353839-11db-4b7a-a4c6-99d7b7038132 req-e40ffb9d-1374-41d0-a2da-e2d4da4f2856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b36131f-5f27-419f-b1b2-da2d6ebc60e5", "name": "network-vif-plugged", "status": "completed", "tag": "df8bdaca-d337-4c5a-a11c-dbedba1578a8"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:27:31.175281 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f7353839-11db-4b7a-a4c6-99d7b7038132 req-e40ffb9d-1374-41d0-a2da-e2d4da4f2856 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:31.175801 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f7353839-11db-4b7a-a4c6-99d7b7038132 req-e40ffb9d-1374-41d0-a2da-e2d4da4f2856 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:31.176308 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f7353839-11db-4b7a-a4c6-99d7b7038132 req-e40ffb9d-1374-41d0-a2da-e2d4da4f2856 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:31.188011 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f7353839-11db-4b7a-a4c6-99d7b7038132 req-e40ffb9d-1374-41d0-a2da-e2d4da4f2856 service nova] Creating event network-vif-plugged:df8bdaca-d337-4c5a-a11c-dbedba1578a8 for instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 on hv-cinder-84984 Sep 15 19:27:31.192996 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f7353839-11db-4b7a-a4c6-99d7b7038132 req-e40ffb9d-1374-41d0-a2da-e2d4da4f2856 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031477 Sep 15 19:27:31.193648 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 53/110] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:27:31.257519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f86b2b3e-1ed6-4eee-aeeb-0fc41340524c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:31.258144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f86b2b3e-1ed6-4eee-aeeb-0fc41340524c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:31.264379 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f86b2b3e-1ed6-4eee-aeeb-0fc41340524c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:31.264995 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f86b2b3e-1ed6-4eee-aeeb-0fc41340524c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:31.265426 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f86b2b3e-1ed6-4eee-aeeb-0fc41340524c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:31.266124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f86b2b3e-1ed6-4eee-aeeb-0fc41340524c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:31.266670 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f86b2b3e-1ed6-4eee-aeeb-0fc41340524c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:31.267096 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f86b2b3e-1ed6-4eee-aeeb-0fc41340524c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:31.405667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f86b2b3e-1ed6-4eee-aeeb-0fc41340524c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:31.414326 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f86b2b3e-1ed6-4eee-aeeb-0fc41340524c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.161052 Sep 15 19:27:31.414932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 58/111] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:31 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:31.532804 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-485ac874-36ed-49f4-bded-92c94f891ee2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:31.533496 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-485ac874-36ed-49f4-bded-92c94f891ee2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:31.540607 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-485ac874-36ed-49f4-bded-92c94f891ee2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:31.541171 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-485ac874-36ed-49f4-bded-92c94f891ee2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:31.541540 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-485ac874-36ed-49f4-bded-92c94f891ee2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:31.542231 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-485ac874-36ed-49f4-bded-92c94f891ee2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:31.542680 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-485ac874-36ed-49f4-bded-92c94f891ee2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:31.543096 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-485ac874-36ed-49f4-bded-92c94f891ee2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:31.708486 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-485ac874-36ed-49f4-bded-92c94f891ee2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:31.720330 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-485ac874-36ed-49f4-bded-92c94f891ee2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.191570 Sep 15 19:27:31.720930 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 54/112] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:31 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:31.824785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-75753c02-f6e4-4942-bd1e-3643d5a51398 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:31.826039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-75753c02-f6e4-4942-bd1e-3643d5a51398 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:31.831765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75753c02-f6e4-4942-bd1e-3643d5a51398 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:31.832254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75753c02-f6e4-4942-bd1e-3643d5a51398 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:31.832691 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75753c02-f6e4-4942-bd1e-3643d5a51398 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:31.833390 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75753c02-f6e4-4942-bd1e-3643d5a51398 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:31.833816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75753c02-f6e4-4942-bd1e-3643d5a51398 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:31.834773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75753c02-f6e4-4942-bd1e-3643d5a51398 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:32.002606 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-75753c02-f6e4-4942-bd1e-3643d5a51398 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:32.011307 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-75753c02-f6e4-4942-bd1e-3643d5a51398 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.191262 Sep 15 19:27:32.011918 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 59/113] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:31 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:32.438363 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-526f9b26-d8d5-4163-bc9d-8cf3e572cd60 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:32.439006 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-526f9b26-d8d5-4163-bc9d-8cf3e572cd60 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:32.453426 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-526f9b26-d8d5-4163-bc9d-8cf3e572cd60 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:32.453426 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-526f9b26-d8d5-4163-bc9d-8cf3e572cd60 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:32.453426 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-526f9b26-d8d5-4163-bc9d-8cf3e572cd60 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:32.454164 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-526f9b26-d8d5-4163-bc9d-8cf3e572cd60 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:32.454325 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-526f9b26-d8d5-4163-bc9d-8cf3e572cd60 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:32.454661 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-526f9b26-d8d5-4163-bc9d-8cf3e572cd60 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:32.590013 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-526f9b26-d8d5-4163-bc9d-8cf3e572cd60 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:32.597588 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-526f9b26-d8d5-4163-bc9d-8cf3e572cd60 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.163269 Sep 15 19:27:32.598219 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 55/114] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:32 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:32.746309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3e229deb-2ddb-4114-936b-eb85cc7820b2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:32.746897 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3e229deb-2ddb-4114-936b-eb85cc7820b2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:32.752933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e229deb-2ddb-4114-936b-eb85cc7820b2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:32.753419 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e229deb-2ddb-4114-936b-eb85cc7820b2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:32.753851 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e229deb-2ddb-4114-936b-eb85cc7820b2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:32.754546 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e229deb-2ddb-4114-936b-eb85cc7820b2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:32.754989 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e229deb-2ddb-4114-936b-eb85cc7820b2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:32.755407 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e229deb-2ddb-4114-936b-eb85cc7820b2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:32.912153 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3e229deb-2ddb-4114-936b-eb85cc7820b2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:32.919925 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3e229deb-2ddb-4114-936b-eb85cc7820b2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.177621 Sep 15 19:27:32.920482 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 60/115] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:32 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:33.034261 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-218bf7c7-ed33-497b-8701-82d8562f4fae tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:33.034867 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-218bf7c7-ed33-497b-8701-82d8562f4fae tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:33.041126 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-218bf7c7-ed33-497b-8701-82d8562f4fae tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:33.041538 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-218bf7c7-ed33-497b-8701-82d8562f4fae tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:33.041968 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-218bf7c7-ed33-497b-8701-82d8562f4fae tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:33.042657 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-218bf7c7-ed33-497b-8701-82d8562f4fae tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:33.043106 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-218bf7c7-ed33-497b-8701-82d8562f4fae tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:33.043524 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-218bf7c7-ed33-497b-8701-82d8562f4fae tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:33.190053 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-218bf7c7-ed33-497b-8701-82d8562f4fae tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:33.199112 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-218bf7c7-ed33-497b-8701-82d8562f4fae tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.168752 Sep 15 19:27:33.199703 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 56/116] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:33 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:33.442689 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-23b11a80-595b-4849-9ad4-99251b6de340 req-596b8999-3b3f-44de-924b-cdd75ac529ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced2825e-adc0-4716-88f5-0b0b297b2b21", "name": "network-vif-plugged", "status": "completed", "tag": "b8d23106-0153-4b20-8a66-916ff52a223e"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:27:33.452660 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-23b11a80-595b-4849-9ad4-99251b6de340 req-596b8999-3b3f-44de-924b-cdd75ac529ad service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:33.453134 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-23b11a80-595b-4849-9ad4-99251b6de340 req-596b8999-3b3f-44de-924b-cdd75ac529ad service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:33.453563 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-23b11a80-595b-4849-9ad4-99251b6de340 req-596b8999-3b3f-44de-924b-cdd75ac529ad service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:33.465449 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-23b11a80-595b-4849-9ad4-99251b6de340 req-596b8999-3b3f-44de-924b-cdd75ac529ad service nova] Creating event network-vif-plugged:b8d23106-0153-4b20-8a66-916ff52a223e for instance ced2825e-adc0-4716-88f5-0b0b297b2b21 on hv-cinder-84984 Sep 15 19:27:33.470714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-23b11a80-595b-4849-9ad4-99251b6de340 req-596b8999-3b3f-44de-924b-cdd75ac529ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031996 Sep 15 19:27:33.471330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 61/117] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:27:33.620774 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6d096a9d-1ef8-4810-89b6-bb658115a549 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:33.621640 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6d096a9d-1ef8-4810-89b6-bb658115a549 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:33.628261 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d096a9d-1ef8-4810-89b6-bb658115a549 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:33.628836 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d096a9d-1ef8-4810-89b6-bb658115a549 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:33.629341 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d096a9d-1ef8-4810-89b6-bb658115a549 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:33.630374 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d096a9d-1ef8-4810-89b6-bb658115a549 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:33.631415 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d096a9d-1ef8-4810-89b6-bb658115a549 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:33.631930 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d096a9d-1ef8-4810-89b6-bb658115a549 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:33.769539 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6d096a9d-1ef8-4810-89b6-bb658115a549 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:33.777795 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6d096a9d-1ef8-4810-89b6-bb658115a549 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.160894 Sep 15 19:27:33.778319 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 57/118] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:33 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:33.946193 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-afdaa4b0-b2f5-43b3-bbfe-664397581d2e tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:33.946962 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-afdaa4b0-b2f5-43b3-bbfe-664397581d2e tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:33.954928 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-afdaa4b0-b2f5-43b3-bbfe-664397581d2e tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:33.955552 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-afdaa4b0-b2f5-43b3-bbfe-664397581d2e tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:33.956147 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-afdaa4b0-b2f5-43b3-bbfe-664397581d2e tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:33.956965 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-afdaa4b0-b2f5-43b3-bbfe-664397581d2e tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:33.957478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-afdaa4b0-b2f5-43b3-bbfe-664397581d2e tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:33.957963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-afdaa4b0-b2f5-43b3-bbfe-664397581d2e tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:34.232222 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-afdaa4b0-b2f5-43b3-bbfe-664397581d2e tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:34.235269 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b460313-589a-4aba-9ba8-7caa05f3370d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:34.238097 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2b460313-589a-4aba-9ba8-7caa05f3370d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:34.252681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-afdaa4b0-b2f5-43b3-bbfe-664397581d2e tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.310080 Sep 15 19:27:34.255785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 62/119] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:33 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:34.257289 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b460313-589a-4aba-9ba8-7caa05f3370d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:34.257430 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b460313-589a-4aba-9ba8-7caa05f3370d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:34.257833 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b460313-589a-4aba-9ba8-7caa05f3370d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:34.258634 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b460313-589a-4aba-9ba8-7caa05f3370d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:34.258971 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b460313-589a-4aba-9ba8-7caa05f3370d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:34.259382 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b460313-589a-4aba-9ba8-7caa05f3370d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:34.444588 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2b460313-589a-4aba-9ba8-7caa05f3370d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:34.457980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2b460313-589a-4aba-9ba8-7caa05f3370d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.233216 Sep 15 19:27:34.458655 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 58/120] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:34 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:34.800455 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2a729a9e-01c7-4dbd-b539-99321ec3b827 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:34.801058 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2a729a9e-01c7-4dbd-b539-99321ec3b827 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:34.807251 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a729a9e-01c7-4dbd-b539-99321ec3b827 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:34.807756 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a729a9e-01c7-4dbd-b539-99321ec3b827 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:34.808186 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a729a9e-01c7-4dbd-b539-99321ec3b827 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:34.808865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a729a9e-01c7-4dbd-b539-99321ec3b827 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:34.809538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a729a9e-01c7-4dbd-b539-99321ec3b827 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:34.809954 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a729a9e-01c7-4dbd-b539-99321ec3b827 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:34.953486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2a729a9e-01c7-4dbd-b539-99321ec3b827 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:34.963464 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2a729a9e-01c7-4dbd-b539-99321ec3b827 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.165271 Sep 15 19:27:34.964153 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 63/121] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:34 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:35.279855 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b9f0a8d6-f43f-4f5f-a673-f140f95c93df tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:35.280896 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b9f0a8d6-f43f-4f5f-a673-f140f95c93df tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:35.287579 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9f0a8d6-f43f-4f5f-a673-f140f95c93df tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:35.288225 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9f0a8d6-f43f-4f5f-a673-f140f95c93df tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:35.288752 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9f0a8d6-f43f-4f5f-a673-f140f95c93df tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:35.289621 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9f0a8d6-f43f-4f5f-a673-f140f95c93df tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:35.290178 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9f0a8d6-f43f-4f5f-a673-f140f95c93df tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:35.290832 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9f0a8d6-f43f-4f5f-a673-f140f95c93df tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:35.433416 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b9f0a8d6-f43f-4f5f-a673-f140f95c93df tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:35.441332 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b9f0a8d6-f43f-4f5f-a673-f140f95c93df tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1315 microversion: 2.1 time: 0.165437 Sep 15 19:27:35.441900 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 59/122] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:35 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:35.481979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-306609e3-4e4a-45a3-97e4-458c20e78dfd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:35.482599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-306609e3-4e4a-45a3-97e4-458c20e78dfd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:35.492218 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-3f7e311b-c4ce-4994-ba59-ef9d81f2cf00 req-5b5fa619-d13f-4268-b2e6-dc5fcb018975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3532b103-32ed-4f98-988c-acdaaca65fa8", "name": "network-vif-plugged", "status": "completed", "tag": "b92511d9-07c9-4977-aff4-3a688548dc81"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:27:35.495266 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-306609e3-4e4a-45a3-97e4-458c20e78dfd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:35.495616 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-306609e3-4e4a-45a3-97e4-458c20e78dfd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:35.496087 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-306609e3-4e4a-45a3-97e4-458c20e78dfd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:35.496796 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-306609e3-4e4a-45a3-97e4-458c20e78dfd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:35.497249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-306609e3-4e4a-45a3-97e4-458c20e78dfd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:35.497667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-306609e3-4e4a-45a3-97e4-458c20e78dfd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:35.502690 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3f7e311b-c4ce-4994-ba59-ef9d81f2cf00 req-5b5fa619-d13f-4268-b2e6-dc5fcb018975 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:35.505161 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3f7e311b-c4ce-4994-ba59-ef9d81f2cf00 req-5b5fa619-d13f-4268-b2e6-dc5fcb018975 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:35.506573 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3f7e311b-c4ce-4994-ba59-ef9d81f2cf00 req-5b5fa619-d13f-4268-b2e6-dc5fcb018975 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:35.524869 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-3f7e311b-c4ce-4994-ba59-ef9d81f2cf00 req-5b5fa619-d13f-4268-b2e6-dc5fcb018975 service nova] Creating event network-vif-plugged:b92511d9-07c9-4977-aff4-3a688548dc81 for instance 3532b103-32ed-4f98-988c-acdaaca65fa8 on hv-cinder-84984 Sep 15 19:27:35.541199 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-3f7e311b-c4ce-4994-ba59-ef9d81f2cf00 req-5b5fa619-d13f-4268-b2e6-dc5fcb018975 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053099 Sep 15 19:27:35.545861 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 60/123] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:27:35.655534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-306609e3-4e4a-45a3-97e4-458c20e78dfd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:35.663994 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-306609e3-4e4a-45a3-97e4-458c20e78dfd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.185824 Sep 15 19:27:35.664570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 64/124] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:35 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:35.987443 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98423910-de4e-4a14-b9f1-355de18c185a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:35.988154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98423910-de4e-4a14-b9f1-355de18c185a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:35.999427 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98423910-de4e-4a14-b9f1-355de18c185a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:36.002867 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98423910-de4e-4a14-b9f1-355de18c185a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:36.003511 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98423910-de4e-4a14-b9f1-355de18c185a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:36.005626 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98423910-de4e-4a14-b9f1-355de18c185a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:36.006858 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98423910-de4e-4a14-b9f1-355de18c185a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:36.011031 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98423910-de4e-4a14-b9f1-355de18c185a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:36.251176 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-98423910-de4e-4a14-b9f1-355de18c185a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:36.259929 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98423910-de4e-4a14-b9f1-355de18c185a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1322 microversion: 2.1 time: 0.276423 Sep 15 19:27:36.260507 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 61/125] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:35 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:36.466557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fef24e03-0b67-4c4c-8145-d943b0265b24 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:36.467462 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fef24e03-0b67-4c4c-8145-d943b0265b24 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:36.480157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fef24e03-0b67-4c4c-8145-d943b0265b24 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:36.480635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fef24e03-0b67-4c4c-8145-d943b0265b24 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:36.481073 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fef24e03-0b67-4c4c-8145-d943b0265b24 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:36.481759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fef24e03-0b67-4c4c-8145-d943b0265b24 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:36.482203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fef24e03-0b67-4c4c-8145-d943b0265b24 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:36.482617 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fef24e03-0b67-4c4c-8145-d943b0265b24 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:36.622477 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fef24e03-0b67-4c4c-8145-d943b0265b24 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:36.630590 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fef24e03-0b67-4c4c-8145-d943b0265b24 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1503 microversion: 2.1 time: 0.167916 Sep 15 19:27:36.631913 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 65/126] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:36 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:36.687844 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f650d008-0051-4f1a-84af-3f4160745e37 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:36.688449 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f650d008-0051-4f1a-84af-3f4160745e37 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:36.694920 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f650d008-0051-4f1a-84af-3f4160745e37 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:36.695748 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f650d008-0051-4f1a-84af-3f4160745e37 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:36.696190 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f650d008-0051-4f1a-84af-3f4160745e37 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:36.696870 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f650d008-0051-4f1a-84af-3f4160745e37 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:36.697313 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f650d008-0051-4f1a-84af-3f4160745e37 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:36.697736 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f650d008-0051-4f1a-84af-3f4160745e37 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:36.877009 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f650d008-0051-4f1a-84af-3f4160745e37 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:36.888174 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f650d008-0051-4f1a-84af-3f4160745e37 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.203924 Sep 15 19:27:36.889834 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 62/127] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:36 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:37.298307 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-740f3d24-6563-4975-9a3d-d0061b16a393 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:37.298307 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-740f3d24-6563-4975-9a3d-d0061b16a393 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:37.298307 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-740f3d24-6563-4975-9a3d-d0061b16a393 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:37.298307 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-740f3d24-6563-4975-9a3d-d0061b16a393 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:37.298775 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-740f3d24-6563-4975-9a3d-d0061b16a393 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:37.298775 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-740f3d24-6563-4975-9a3d-d0061b16a393 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:37.298775 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-740f3d24-6563-4975-9a3d-d0061b16a393 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:37.298775 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-740f3d24-6563-4975-9a3d-d0061b16a393 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:37.426138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-740f3d24-6563-4975-9a3d-d0061b16a393 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:37.434667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-740f3d24-6563-4975-9a3d-d0061b16a393 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1517 microversion: 2.1 time: 0.155113 Sep 15 19:27:37.435252 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 66/128] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:37 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:37.460164 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b024b528-723c-417d-b7a4-43fec80da6ec tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:27:37.462401 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b024b528-723c-417d-b7a4-43fec80da6ec tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:37.468868 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b024b528-723c-417d-b7a4-43fec80da6ec tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:37.469349 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b024b528-723c-417d-b7a4-43fec80da6ec tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:37.469949 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b024b528-723c-417d-b7a4-43fec80da6ec tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:37.470651 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b024b528-723c-417d-b7a4-43fec80da6ec tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:37.471104 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b024b528-723c-417d-b7a4-43fec80da6ec tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:37.471526 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b024b528-723c-417d-b7a4-43fec80da6ec tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:37.527815 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:37.534452 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-b024b528-723c-417d-b7a4-43fec80da6ec tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lazy-loading 'flavor' on Instance uuid ced2825e-adc0-4716-88f5-0b0b297b2b21 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:27:37.924874 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7c1d687f-e34f-4ff6-9756-15dbe02eb4d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:37.925478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7c1d687f-e34f-4ff6-9756-15dbe02eb4d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:37.932531 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c1d687f-e34f-4ff6-9756-15dbe02eb4d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:37.933006 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c1d687f-e34f-4ff6-9756-15dbe02eb4d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:37.933435 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c1d687f-e34f-4ff6-9756-15dbe02eb4d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:37.934116 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c1d687f-e34f-4ff6-9756-15dbe02eb4d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:37.934557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c1d687f-e34f-4ff6-9756-15dbe02eb4d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:37.934973 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c1d687f-e34f-4ff6-9756-15dbe02eb4d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:37.954247 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:37.981487 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b024b528-723c-417d-b7a4-43fec80da6ec tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "POST /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21/action" status: 200 len: 32 microversion: 2.1 time: 0.525320 Sep 15 19:27:37.988072 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 63/129] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:27:37 2022] POST /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21/action => generated 32 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 19:27:37.997794 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6c95b90c-0fbe-41d6-885a-f7e25af2b253 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:37.999121 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6c95b90c-0fbe-41d6-885a-f7e25af2b253 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:38.008505 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c95b90c-0fbe-41d6-885a-f7e25af2b253 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:38.009511 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c95b90c-0fbe-41d6-885a-f7e25af2b253 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:38.009950 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c95b90c-0fbe-41d6-885a-f7e25af2b253 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:38.011155 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c95b90c-0fbe-41d6-885a-f7e25af2b253 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:38.011619 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c95b90c-0fbe-41d6-885a-f7e25af2b253 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:38.012123 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c95b90c-0fbe-41d6-885a-f7e25af2b253 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:38.144478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7c1d687f-e34f-4ff6-9756-15dbe02eb4d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:38.153285 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7c1d687f-e34f-4ff6-9756-15dbe02eb4d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.232080 Sep 15 19:27:38.169534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 67/130] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:37 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:38.469190 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6c95b90c-0fbe-41d6-885a-f7e25af2b253 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:38.477893 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6c95b90c-0fbe-41d6-885a-f7e25af2b253 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.484593 Sep 15 19:27:38.478466 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 64/131] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:37 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:39.179337 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-332dbf67-3376-4203-a294-ccb31dc504e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:39.180595 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-332dbf67-3376-4203-a294-ccb31dc504e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:39.192353 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-332dbf67-3376-4203-a294-ccb31dc504e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:39.192353 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-332dbf67-3376-4203-a294-ccb31dc504e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:39.192353 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-332dbf67-3376-4203-a294-ccb31dc504e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:39.192353 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-332dbf67-3376-4203-a294-ccb31dc504e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:39.192646 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-332dbf67-3376-4203-a294-ccb31dc504e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:39.192646 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-332dbf67-3376-4203-a294-ccb31dc504e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:39.406723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-332dbf67-3376-4203-a294-ccb31dc504e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:39.417423 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-332dbf67-3376-4203-a294-ccb31dc504e6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1367 microversion: 2.1 time: 0.242824 Sep 15 19:27:39.420922 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 68/132] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:39 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:39.502194 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3c781d8-c3bd-4592-b47b-ea8bc7fdea77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:39.502723 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d3c781d8-c3bd-4592-b47b-ea8bc7fdea77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:39.509394 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c781d8-c3bd-4592-b47b-ea8bc7fdea77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:39.509872 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c781d8-c3bd-4592-b47b-ea8bc7fdea77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:39.510296 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c781d8-c3bd-4592-b47b-ea8bc7fdea77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:39.511014 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c781d8-c3bd-4592-b47b-ea8bc7fdea77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:39.511487 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c781d8-c3bd-4592-b47b-ea8bc7fdea77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:39.512014 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c781d8-c3bd-4592-b47b-ea8bc7fdea77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:39.649206 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3c781d8-c3bd-4592-b47b-ea8bc7fdea77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:39.654218 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d3c781d8-c3bd-4592-b47b-ea8bc7fdea77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.156260 Sep 15 19:27:39.654947 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 65/133] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:39 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:40.468783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0c4c1a46-032b-4f40-8605-0e23b2da22a1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:40.468783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0c4c1a46-032b-4f40-8605-0e23b2da22a1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:40.468783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c4c1a46-032b-4f40-8605-0e23b2da22a1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:40.468783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c4c1a46-032b-4f40-8605-0e23b2da22a1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:40.469607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c4c1a46-032b-4f40-8605-0e23b2da22a1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:40.469607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c4c1a46-032b-4f40-8605-0e23b2da22a1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:40.469607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c4c1a46-032b-4f40-8605-0e23b2da22a1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:40.469607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c4c1a46-032b-4f40-8605-0e23b2da22a1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:40.477730 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a442c8f-e36c-4314-9c9d-5d022e635476 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d1c6433-ef9b-4bac-a125-9d181db399ee"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:27:40.480343 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3a442c8f-e36c-4314-9c9d-5d022e635476 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:40.493473 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a442c8f-e36c-4314-9c9d-5d022e635476 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:40.493960 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a442c8f-e36c-4314-9c9d-5d022e635476 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:40.497937 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a442c8f-e36c-4314-9c9d-5d022e635476 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:40.499194 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a442c8f-e36c-4314-9c9d-5d022e635476 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:40.500106 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a442c8f-e36c-4314-9c9d-5d022e635476 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:40.500844 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a442c8f-e36c-4314-9c9d-5d022e635476 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:40.937240 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0c4c1a46-032b-4f40-8605-0e23b2da22a1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:40.946174 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0c4c1a46-032b-4f40-8605-0e23b2da22a1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1557 microversion: 2.1 time: 0.500928 Sep 15 19:27:40.946794 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 69/134] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:40 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1557 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:40.957087 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0aae75a0-7fbb-48c6-9c18-34074514ab83 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:40.957087 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0aae75a0-7fbb-48c6-9c18-34074514ab83 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:40.962251 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0aae75a0-7fbb-48c6-9c18-34074514ab83 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:40.962909 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0aae75a0-7fbb-48c6-9c18-34074514ab83 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:40.964035 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0aae75a0-7fbb-48c6-9c18-34074514ab83 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:40.964237 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0aae75a0-7fbb-48c6-9c18-34074514ab83 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:40.964786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0aae75a0-7fbb-48c6-9c18-34074514ab83 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:40.965199 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0aae75a0-7fbb-48c6-9c18-34074514ab83 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:41.185289 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0aae75a0-7fbb-48c6-9c18-34074514ab83 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:41.193282 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0aae75a0-7fbb-48c6-9c18-34074514ab83 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.245471 Sep 15 19:27:41.193953 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 70/135] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:40 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:41.199030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0d017742-19e7-48a2-84e5-5a8af5024fc8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:41.199608 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0d017742-19e7-48a2-84e5-5a8af5024fc8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:41.202110 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=75 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:41.208981 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d017742-19e7-48a2-84e5-5a8af5024fc8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:41.209737 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d017742-19e7-48a2-84e5-5a8af5024fc8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:41.210378 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d017742-19e7-48a2-84e5-5a8af5024fc8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:41.211093 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d017742-19e7-48a2-84e5-5a8af5024fc8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:41.211550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d017742-19e7-48a2-84e5-5a8af5024fc8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:41.212034 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d017742-19e7-48a2-84e5-5a8af5024fc8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:41.345803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0d017742-19e7-48a2-84e5-5a8af5024fc8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150399 Sep 15 19:27:41.346400 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 71/136] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 15 19:27:41 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:27:42.217266 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-852565a0-3d67-4c71-8dfa-d101adabdcf8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:42.217916 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-852565a0-3d67-4c71-8dfa-d101adabdcf8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:42.224339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-852565a0-3d67-4c71-8dfa-d101adabdcf8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:42.225436 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-852565a0-3d67-4c71-8dfa-d101adabdcf8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:42.225867 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-852565a0-3d67-4c71-8dfa-d101adabdcf8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:42.230865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-852565a0-3d67-4c71-8dfa-d101adabdcf8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:42.230865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-852565a0-3d67-4c71-8dfa-d101adabdcf8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:42.230865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-852565a0-3d67-4c71-8dfa-d101adabdcf8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:42.471413 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-852565a0-3d67-4c71-8dfa-d101adabdcf8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:42.480322 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-852565a0-3d67-4c71-8dfa-d101adabdcf8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.266994 Sep 15 19:27:42.480901 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 72/137] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:42 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:42.642000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3a442c8f-e36c-4314-9c9d-5d022e635476 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "POST /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.169379 Sep 15 19:27:42.647624 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 66/138] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:27:40 2022] POST /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb/os-volume_attachments => generated 194 bytes in 2172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:27:42.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-c46e6364-c5f7-43c0-892a-ec13b7645da0 req-df2fd810-0b8f-4914-9727-f43bf23368c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3532b103-32ed-4f98-988c-acdaaca65fa8", "tag": "b92511d9-07c9-4977-aff4-3a688548dc81"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:27:42.983399 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c46e6364-c5f7-43c0-892a-ec13b7645da0 req-df2fd810-0b8f-4914-9727-f43bf23368c8 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:42.983907 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c46e6364-c5f7-43c0-892a-ec13b7645da0 req-df2fd810-0b8f-4914-9727-f43bf23368c8 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:42.984330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c46e6364-c5f7-43c0-892a-ec13b7645da0 req-df2fd810-0b8f-4914-9727-f43bf23368c8 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:43.009471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-c46e6364-c5f7-43c0-892a-ec13b7645da0 req-df2fd810-0b8f-4914-9727-f43bf23368c8 service nova] Creating event network-changed:b92511d9-07c9-4977-aff4-3a688548dc81 for instance 3532b103-32ed-4f98-988c-acdaaca65fa8 on hv-cinder-84984 Sep 15 19:27:43.015631 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-c46e6364-c5f7-43c0-892a-ec13b7645da0 req-df2fd810-0b8f-4914-9727-f43bf23368c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045722 Sep 15 19:27:43.016256 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 73/139] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:27:43.517744 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6942c81-16e2-4901-bd47-fb2799ef4376 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:43.520676 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a6942c81-16e2-4901-bd47-fb2799ef4376 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:43.533520 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6942c81-16e2-4901-bd47-fb2799ef4376 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:43.534008 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6942c81-16e2-4901-bd47-fb2799ef4376 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:43.534440 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6942c81-16e2-4901-bd47-fb2799ef4376 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:43.535144 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6942c81-16e2-4901-bd47-fb2799ef4376 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:43.536421 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6942c81-16e2-4901-bd47-fb2799ef4376 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:43.536421 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6942c81-16e2-4901-bd47-fb2799ef4376 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:43.693108 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a6942c81-16e2-4901-bd47-fb2799ef4376 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:43.701830 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a6942c81-16e2-4901-bd47-fb2799ef4376 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.188886 Sep 15 19:27:43.702414 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 67/140] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:43 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:44.725539 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-67d0a567-085a-48ac-8c45-42ebb0a9a214 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:44.726300 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-67d0a567-085a-48ac-8c45-42ebb0a9a214 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:44.732430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67d0a567-085a-48ac-8c45-42ebb0a9a214 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:44.732913 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67d0a567-085a-48ac-8c45-42ebb0a9a214 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:44.733349 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67d0a567-085a-48ac-8c45-42ebb0a9a214 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:44.734040 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67d0a567-085a-48ac-8c45-42ebb0a9a214 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:44.734489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67d0a567-085a-48ac-8c45-42ebb0a9a214 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:44.734910 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67d0a567-085a-48ac-8c45-42ebb0a9a214 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:44.870096 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-67d0a567-085a-48ac-8c45-42ebb0a9a214 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:44.877954 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-67d0a567-085a-48ac-8c45-42ebb0a9a214 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.157224 Sep 15 19:27:44.878522 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 74/141] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:44 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:45.901564 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4de713d0-b6e3-4c5e-bbab-7f836665a79a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:45.902163 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4de713d0-b6e3-4c5e-bbab-7f836665a79a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:45.908755 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4de713d0-b6e3-4c5e-bbab-7f836665a79a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:45.909240 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4de713d0-b6e3-4c5e-bbab-7f836665a79a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:45.909676 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4de713d0-b6e3-4c5e-bbab-7f836665a79a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:45.910506 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4de713d0-b6e3-4c5e-bbab-7f836665a79a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:45.911012 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4de713d0-b6e3-4c5e-bbab-7f836665a79a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:45.911438 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4de713d0-b6e3-4c5e-bbab-7f836665a79a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:46.062972 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4de713d0-b6e3-4c5e-bbab-7f836665a79a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:46.082216 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4de713d0-b6e3-4c5e-bbab-7f836665a79a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.184318 Sep 15 19:27:46.083180 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 68/142] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:45 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:47.113919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-54c7cd9a-1573-4945-a970-868590607293 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:47.114485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-54c7cd9a-1573-4945-a970-868590607293 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:47.121089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54c7cd9a-1573-4945-a970-868590607293 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:47.121569 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54c7cd9a-1573-4945-a970-868590607293 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:47.122024 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54c7cd9a-1573-4945-a970-868590607293 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:47.122726 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54c7cd9a-1573-4945-a970-868590607293 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:47.123238 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54c7cd9a-1573-4945-a970-868590607293 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:47.124082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54c7cd9a-1573-4945-a970-868590607293 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:47.257887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-54c7cd9a-1573-4945-a970-868590607293 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:47.265985 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-54c7cd9a-1573-4945-a970-868590607293 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.156130 Sep 15 19:27:47.266615 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 75/143] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:47 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:48.288910 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d787c205-4bfb-44e8-8c08-1c695fe143e2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:48.291826 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d787c205-4bfb-44e8-8c08-1c695fe143e2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:48.291989 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=68 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:48.296718 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d787c205-4bfb-44e8-8c08-1c695fe143e2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:48.297199 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d787c205-4bfb-44e8-8c08-1c695fe143e2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:48.297632 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d787c205-4bfb-44e8-8c08-1c695fe143e2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:48.298321 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d787c205-4bfb-44e8-8c08-1c695fe143e2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:48.298776 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d787c205-4bfb-44e8-8c08-1c695fe143e2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:48.299197 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d787c205-4bfb-44e8-8c08-1c695fe143e2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:48.433279 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d787c205-4bfb-44e8-8c08-1c695fe143e2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:48.441224 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d787c205-4bfb-44e8-8c08-1c695fe143e2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.156063 Sep 15 19:27:48.442047 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 69/144] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:48 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:49.467178 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8ddb73f5-2ea2-4eda-ad06-efdb420893f8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:49.468086 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8ddb73f5-2ea2-4eda-ad06-efdb420893f8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:49.474943 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ddb73f5-2ea2-4eda-ad06-efdb420893f8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:49.475476 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ddb73f5-2ea2-4eda-ad06-efdb420893f8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:49.475943 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ddb73f5-2ea2-4eda-ad06-efdb420893f8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:49.476671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ddb73f5-2ea2-4eda-ad06-efdb420893f8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:49.477118 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ddb73f5-2ea2-4eda-ad06-efdb420893f8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:49.477543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ddb73f5-2ea2-4eda-ad06-efdb420893f8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:49.605919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8ddb73f5-2ea2-4eda-ad06-efdb420893f8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:49.613583 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8ddb73f5-2ea2-4eda-ad06-efdb420893f8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.151135 Sep 15 19:27:49.614144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 76/145] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:49 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:50.636388 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90589a82-d18c-427c-bbb1-419a33a1235e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:50.636998 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90589a82-d18c-427c-bbb1-419a33a1235e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:50.643898 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90589a82-d18c-427c-bbb1-419a33a1235e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:50.644382 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90589a82-d18c-427c-bbb1-419a33a1235e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:50.644818 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90589a82-d18c-427c-bbb1-419a33a1235e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:50.645512 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90589a82-d18c-427c-bbb1-419a33a1235e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:50.646015 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90589a82-d18c-427c-bbb1-419a33a1235e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:50.646436 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90589a82-d18c-427c-bbb1-419a33a1235e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:50.789613 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-90589a82-d18c-427c-bbb1-419a33a1235e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:50.799015 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90589a82-d18c-427c-bbb1-419a33a1235e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.165383 Sep 15 19:27:50.799976 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 70/146] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:50 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:51.826205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-44f6dec5-698c-4050-9d46-8c03d45000c2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:51.826734 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-44f6dec5-698c-4050-9d46-8c03d45000c2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:51.832904 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44f6dec5-698c-4050-9d46-8c03d45000c2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:51.833383 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44f6dec5-698c-4050-9d46-8c03d45000c2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:51.833846 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44f6dec5-698c-4050-9d46-8c03d45000c2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:51.834589 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44f6dec5-698c-4050-9d46-8c03d45000c2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:51.835042 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44f6dec5-698c-4050-9d46-8c03d45000c2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:51.835466 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44f6dec5-698c-4050-9d46-8c03d45000c2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:51.980092 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-44f6dec5-698c-4050-9d46-8c03d45000c2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:51.987880 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-44f6dec5-698c-4050-9d46-8c03d45000c2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.165526 Sep 15 19:27:52.008646 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 77/147] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:51 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:53.015479 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a88fb894-8528-4342-b875-773d319f2987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:53.017165 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a88fb894-8528-4342-b875-773d319f2987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:53.024864 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a88fb894-8528-4342-b875-773d319f2987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:53.025354 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a88fb894-8528-4342-b875-773d319f2987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:53.025792 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a88fb894-8528-4342-b875-773d319f2987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:53.026585 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a88fb894-8528-4342-b875-773d319f2987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:53.026935 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a88fb894-8528-4342-b875-773d319f2987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:53.027624 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a88fb894-8528-4342-b875-773d319f2987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:53.180268 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a88fb894-8528-4342-b875-773d319f2987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:53.188048 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a88fb894-8528-4342-b875-773d319f2987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.177214 Sep 15 19:27:53.188650 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 71/148] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:53 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:54.210926 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8ed108db-1903-49f0-9a31-a30b20b33570 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:54.211531 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8ed108db-1903-49f0-9a31-a30b20b33570 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:54.217790 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ed108db-1903-49f0-9a31-a30b20b33570 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:54.218299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ed108db-1903-49f0-9a31-a30b20b33570 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:54.218732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ed108db-1903-49f0-9a31-a30b20b33570 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:54.219434 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ed108db-1903-49f0-9a31-a30b20b33570 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:54.219994 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ed108db-1903-49f0-9a31-a30b20b33570 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:54.220395 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ed108db-1903-49f0-9a31-a30b20b33570 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:54.380495 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8ed108db-1903-49f0-9a31-a30b20b33570 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:54.389068 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8ed108db-1903-49f0-9a31-a30b20b33570 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.182053 Sep 15 19:27:54.389640 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 78/149] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:54 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:27:55.412909 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-64ede2cd-6a8b-4ac5-a85e-8a9693e75430 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:55.415366 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-64ede2cd-6a8b-4ac5-a85e-8a9693e75430 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:55.431441 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64ede2cd-6a8b-4ac5-a85e-8a9693e75430 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:55.432234 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64ede2cd-6a8b-4ac5-a85e-8a9693e75430 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:55.432668 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64ede2cd-6a8b-4ac5-a85e-8a9693e75430 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:55.433374 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64ede2cd-6a8b-4ac5-a85e-8a9693e75430 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:55.433827 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64ede2cd-6a8b-4ac5-a85e-8a9693e75430 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:55.434248 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64ede2cd-6a8b-4ac5-a85e-8a9693e75430 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:55.576283 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-64ede2cd-6a8b-4ac5-a85e-8a9693e75430 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:55.591915 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-64ede2cd-6a8b-4ac5-a85e-8a9693e75430 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.181697 Sep 15 19:27:55.608299 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 72/150] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:55 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:55.738031 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5ae56e6a-d221-4f60-80d0-3f30b6c986fb tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:55.740062 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5ae56e6a-d221-4f60-80d0-3f30b6c986fb tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:55.745745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ae56e6a-d221-4f60-80d0-3f30b6c986fb tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:55.746237 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ae56e6a-d221-4f60-80d0-3f30b6c986fb tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:55.746993 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ae56e6a-d221-4f60-80d0-3f30b6c986fb tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:55.747371 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ae56e6a-d221-4f60-80d0-3f30b6c986fb tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:55.748625 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ae56e6a-d221-4f60-80d0-3f30b6c986fb tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:55.749020 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ae56e6a-d221-4f60-80d0-3f30b6c986fb tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:55.777440 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5ae56e6a-d221-4f60-80d0-3f30b6c986fb tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:27:56.236655 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5ae56e6a-d221-4f60-80d0-3f30b6c986fb tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "DELETE /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 204 len: 0 microversion: 2.1 time: 0.502435 Sep 15 19:27:56.237347 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 79/151] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:27:55 2022] DELETE /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 19:27:56.249000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b8898f98-690a-4251-8a61-7718be12e126 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:56.249000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b8898f98-690a-4251-8a61-7718be12e126 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:56.252773 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8898f98-690a-4251-8a61-7718be12e126 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:56.253253 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8898f98-690a-4251-8a61-7718be12e126 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:56.253689 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8898f98-690a-4251-8a61-7718be12e126 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:56.254743 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8898f98-690a-4251-8a61-7718be12e126 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:56.255981 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8898f98-690a-4251-8a61-7718be12e126 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:56.255981 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8898f98-690a-4251-8a61-7718be12e126 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:56.471106 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b8898f98-690a-4251-8a61-7718be12e126 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:56.487092 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b8898f98-690a-4251-8a61-7718be12e126 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1555 microversion: 2.1 time: 0.244657 Sep 15 19:27:56.490171 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 73/152] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:56 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:56.627733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2f220594-e281-4e08-9d04-07e069b45d08 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:56.627733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2f220594-e281-4e08-9d04-07e069b45d08 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:56.642339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f220594-e281-4e08-9d04-07e069b45d08 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:56.642890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f220594-e281-4e08-9d04-07e069b45d08 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:56.644891 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f220594-e281-4e08-9d04-07e069b45d08 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:56.649041 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f220594-e281-4e08-9d04-07e069b45d08 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:56.649920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f220594-e281-4e08-9d04-07e069b45d08 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:56.651522 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f220594-e281-4e08-9d04-07e069b45d08 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:56.847407 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2f220594-e281-4e08-9d04-07e069b45d08 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:56.863747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2f220594-e281-4e08-9d04-07e069b45d08 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.244872 Sep 15 19:27:56.865192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 80/153] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:56 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:57.514763 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3b70288d-475e-4d04-b08e-98a11497ba26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:57.515409 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3b70288d-475e-4d04-b08e-98a11497ba26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:57.522396 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b70288d-475e-4d04-b08e-98a11497ba26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:57.522979 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b70288d-475e-4d04-b08e-98a11497ba26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:57.523431 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b70288d-475e-4d04-b08e-98a11497ba26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:57.524157 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b70288d-475e-4d04-b08e-98a11497ba26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:57.524608 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b70288d-475e-4d04-b08e-98a11497ba26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:57.525032 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b70288d-475e-4d04-b08e-98a11497ba26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:57.681032 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3b70288d-475e-4d04-b08e-98a11497ba26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:57.689076 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3b70288d-475e-4d04-b08e-98a11497ba26 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1555 microversion: 2.1 time: 0.177906 Sep 15 19:27:57.690408 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 74/154] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:57 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:57.887435 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-82ea63d3-0443-4390-90e5-7bc6398384c9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:57.888106 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-82ea63d3-0443-4390-90e5-7bc6398384c9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:57.894353 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82ea63d3-0443-4390-90e5-7bc6398384c9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:57.895063 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82ea63d3-0443-4390-90e5-7bc6398384c9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:57.895288 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82ea63d3-0443-4390-90e5-7bc6398384c9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:57.896030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82ea63d3-0443-4390-90e5-7bc6398384c9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:57.896983 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82ea63d3-0443-4390-90e5-7bc6398384c9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:57.897556 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82ea63d3-0443-4390-90e5-7bc6398384c9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:58.080408 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-82ea63d3-0443-4390-90e5-7bc6398384c9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:58.096629 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-82ea63d3-0443-4390-90e5-7bc6398384c9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.213027 Sep 15 19:27:58.098381 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 81/155] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:57 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:58.726953 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5722f301-4de4-42e6-9968-9e9068be4e28 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:58.728818 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5722f301-4de4-42e6-9968-9e9068be4e28 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:58.739817 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5722f301-4de4-42e6-9968-9e9068be4e28 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:58.741019 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5722f301-4de4-42e6-9968-9e9068be4e28 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:58.741738 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5722f301-4de4-42e6-9968-9e9068be4e28 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:58.742968 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5722f301-4de4-42e6-9968-9e9068be4e28 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:58.743172 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5722f301-4de4-42e6-9968-9e9068be4e28 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:58.743618 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5722f301-4de4-42e6-9968-9e9068be4e28 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:58.932128 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5722f301-4de4-42e6-9968-9e9068be4e28 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:58.943094 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5722f301-4de4-42e6-9968-9e9068be4e28 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1555 microversion: 2.1 time: 0.232477 Sep 15 19:27:58.948795 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 75/156] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:58 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1555 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:59.006809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-3e233857-c339-4d24-88ca-15516b5293c5 req-61b42833-52a6-449a-9f03-9bed4d7b8e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ffe7b2-9cde-408a-b314-8c18c02ca8fb", "name": "network-vif-deleted", "tag": "feb98b2b-660f-43d5-86f0-4251ddf907d1"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:27:59.029461 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-3e233857-c339-4d24-88ca-15516b5293c5 req-61b42833-52a6-449a-9f03-9bed4d7b8e9a service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:59.030638 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-3e233857-c339-4d24-88ca-15516b5293c5 req-61b42833-52a6-449a-9f03-9bed4d7b8e9a service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:59.031064 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-3e233857-c339-4d24-88ca-15516b5293c5 req-61b42833-52a6-449a-9f03-9bed4d7b8e9a service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:59.064880 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-3e233857-c339-4d24-88ca-15516b5293c5 req-61b42833-52a6-449a-9f03-9bed4d7b8e9a service nova] Creating event network-vif-deleted:feb98b2b-660f-43d5-86f0-4251ddf907d1 for instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb on hv-cinder-84984 Sep 15 19:27:59.073253 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-3e233857-c339-4d24-88ca-15516b5293c5 req-61b42833-52a6-449a-9f03-9bed4d7b8e9a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071186 Sep 15 19:27:59.081523 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 82/157] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:27:59.140246 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e8a3476d-a403-4f3d-b2a8-64788d89d73e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:59.140907 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e8a3476d-a403-4f3d-b2a8-64788d89d73e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:59.150458 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8a3476d-a403-4f3d-b2a8-64788d89d73e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:59.150970 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8a3476d-a403-4f3d-b2a8-64788d89d73e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:59.151409 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8a3476d-a403-4f3d-b2a8-64788d89d73e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:59.152343 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8a3476d-a403-4f3d-b2a8-64788d89d73e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:59.152822 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8a3476d-a403-4f3d-b2a8-64788d89d73e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:59.153466 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8a3476d-a403-4f3d-b2a8-64788d89d73e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:59.299552 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e8a3476d-a403-4f3d-b2a8-64788d89d73e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:27:59.303797 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:59.308716 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e8a3476d-a403-4f3d-b2a8-64788d89d73e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.172999 Sep 15 19:27:59.309299 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 76/158] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:59 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:27:59.975596 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:27:59.976334 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:27:59.983406 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:59.984095 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:59.984699 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:27:59.985752 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:27:59.986353 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:27:59.986791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:00.024239 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:00.024895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:00.025321 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:00.025815 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lazy-loading 'fault' on Instance uuid 49ffe7b2-9cde-408a-b314-8c18c02ca8fb {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:28:00.080307 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab4dbb6c98f4c99bbb06f586aaddeba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a866fb1264140c1a1056696bf6fabc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:00.087406 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:00.090334 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-aeb5de22-356a-424d-83bd-8ccb7bde5f2a tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 200 len: 1351 microversion: 2.1 time: 0.120347 Sep 15 19:28:00.091412 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 83/159] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:27:59 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 1351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:00.336571 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-176b8694-5b27-4c4b-b7e0-3a7a4ad08607 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:00.338066 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-176b8694-5b27-4c4b-b7e0-3a7a4ad08607 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:00.347946 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-176b8694-5b27-4c4b-b7e0-3a7a4ad08607 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:00.348518 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-176b8694-5b27-4c4b-b7e0-3a7a4ad08607 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:00.349014 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-176b8694-5b27-4c4b-b7e0-3a7a4ad08607 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:00.350307 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-176b8694-5b27-4c4b-b7e0-3a7a4ad08607 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:00.350750 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-176b8694-5b27-4c4b-b7e0-3a7a4ad08607 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:00.351336 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-176b8694-5b27-4c4b-b7e0-3a7a4ad08607 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:00.505302 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-176b8694-5b27-4c4b-b7e0-3a7a4ad08607 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:00.513257 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-176b8694-5b27-4c4b-b7e0-3a7a4ad08607 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.184722 Sep 15 19:28:00.513821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 77/160] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:00 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:01.114497 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6ff17b6d-1533-4e52-84d7-3c19df0f3bc2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:01.115081 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6ff17b6d-1533-4e52-84d7-3c19df0f3bc2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:01.122119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ff17b6d-1533-4e52-84d7-3c19df0f3bc2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:01.122733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ff17b6d-1533-4e52-84d7-3c19df0f3bc2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:01.123289 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ff17b6d-1533-4e52-84d7-3c19df0f3bc2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:01.124019 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ff17b6d-1533-4e52-84d7-3c19df0f3bc2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:01.124475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ff17b6d-1533-4e52-84d7-3c19df0f3bc2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:01.124898 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ff17b6d-1533-4e52-84d7-3c19df0f3bc2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:01.140957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-6ff17b6d-1533-4e52-84d7-3c19df0f3bc2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] HTTP exception thrown: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6ff17b6d-1533-4e52-84d7-3c19df0f3bc2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Request method failure captured: Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb HTTP/1.1 Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3xxvRw898gP3VHXT00Prpp-_wU4negdUD8awtSBAkYep2uv0E2eaUegPb_tvVhs42jx-NTefp8dqc_LmB3hygZodM3Ca7TysKefY0aOAFyO3HTZcd3Tz1PYGXUvIaZJbSjeJ7GOFZldw_83T8-hVNvAh8x-LdhZBU4Ean137bmW_Y4 Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 4a866fb1264140c1a1056696bf6fabc7 Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-DeleteServersTestJSON-1559077497 Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:28:01.145643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:28:01.147083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4a866fb1264140c1a1056696bf6fabc7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4a866fb1264140c1a1056696bf6fabc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4a866fb1264140c1a1056696bf6fabc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4a866fb1264140c1a1056696bf6fabc7"}]}] Sep 15 19:28:01.147083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-DeleteServersTestJSON-1559077497 Sep 15 19:28:01.147083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 4a866fb1264140c1a1056696bf6fabc7 Sep 15 19:28:01.147083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-DeleteServersTestJSON-1559077497 Sep 15 19:28:01.147083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-DeleteServersTestJSON-1559077497-project Sep 15 19:28:01.147083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:28:01.147083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:28:01.147083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 1ab4dbb6c98f4c99bbb06f586aaddeba Sep 15 19:28:01.147083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-DeleteServersTestJSON-1559077497-project Sep 15 19:28:01.147083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:28:01.147083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:01.147083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '49ffe7b2-9cde-408a-b314-8c18c02ca8fb'} Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:28:01.147878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:01.149376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:28:01.150495 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6ff17b6d-1533-4e52-84d7-3c19df0f3bc2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Returning 404 to user: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:28:01.150495 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6ff17b6d-1533-4e52-84d7-3c19df0f3bc2 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 404 len: 111 microversion: 2.1 time: 0.039188 Sep 15 19:28:01.150495 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 84/161] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:01 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:28:01.270659 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9baf02b0-5e4b-4f5b-aab3-719f24565e22 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:01.272295 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9baf02b0-5e4b-4f5b-aab3-719f24565e22 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:01.278254 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9baf02b0-5e4b-4f5b-aab3-719f24565e22 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:01.278728 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9baf02b0-5e4b-4f5b-aab3-719f24565e22 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:01.279163 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9baf02b0-5e4b-4f5b-aab3-719f24565e22 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:01.279865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9baf02b0-5e4b-4f5b-aab3-719f24565e22 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:01.280309 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9baf02b0-5e4b-4f5b-aab3-719f24565e22 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:01.280723 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9baf02b0-5e4b-4f5b-aab3-719f24565e22 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:01.294318 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-9baf02b0-5e4b-4f5b-aab3-719f24565e22 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] HTTP exception thrown: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9baf02b0-5e4b-4f5b-aab3-719f24565e22 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Request method failure captured: Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb/os-volume_attachments HTTP/1.1 Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Connection: close Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Host: 10.222.0.18 Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjI3xxvRw898gP3VHXT00Prpp-_wU4negdUD8awtSBAkYep2uv0E2eaUegPb_tvVhs42jx-NTefp8dqc_LmB3hygZodM3Ca7TysKefY0aOAFyO3HTZcd3Tz1PYGXUvIaZJbSjeJ7GOFZldw_83T8-hVNvAh8x-LdhZBU4Ean137bmW_Y4 Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Id: 4a866fb1264140c1a1056696bf6fabc7 Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-1559077497 Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Role: member,reader Sep 15 19:28:01.298583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Roles: member,reader Sep 15 19:28:01.300840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4a866fb1264140c1a1056696bf6fabc7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4a866fb1264140c1a1056696bf6fabc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4a866fb1264140c1a1056696bf6fabc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4a866fb1264140c1a1056696bf6fabc7"}]}] Sep 15 19:28:01.300840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-1559077497 Sep 15 19:28:01.300840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 4a866fb1264140c1a1056696bf6fabc7 Sep 15 19:28:01.300840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-1559077497 Sep 15 19:28:01.300840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-1559077497-project Sep 15 19:28:01.300840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 15 19:28:01.300840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 15 19:28:01.300840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Id: 1ab4dbb6c98f4c99bbb06f586aaddeba Sep 15 19:28:01.300840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-1559077497-project Sep 15 19:28:01.300840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: method: > Sep 15 19:28:01.300840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: exception: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:01.300840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: action_args: {'server_id': '49ffe7b2-9cde-408a-b314-8c18c02ca8fb'} Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:28:01.301737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:01.303558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:01.305250 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9baf02b0-5e4b-4f5b-aab3-719f24565e22 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Returning 404 to user: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:28:01.305250 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9baf02b0-5e4b-4f5b-aab3-719f24565e22 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034032 Sep 15 19:28:01.305250 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 78/162] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:28:01 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:28:01.541079 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e38aab85-930f-471e-85da-c475bcacd6c6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:01.542323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e38aab85-930f-471e-85da-c475bcacd6c6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:01.551321 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e38aab85-930f-471e-85da-c475bcacd6c6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:01.552373 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e38aab85-930f-471e-85da-c475bcacd6c6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:01.553837 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e38aab85-930f-471e-85da-c475bcacd6c6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:01.554823 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e38aab85-930f-471e-85da-c475bcacd6c6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:01.555333 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e38aab85-930f-471e-85da-c475bcacd6c6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:01.555770 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e38aab85-930f-471e-85da-c475bcacd6c6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:01.736466 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e38aab85-930f-471e-85da-c475bcacd6c6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:01.749951 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e38aab85-930f-471e-85da-c475bcacd6c6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.214014 Sep 15 19:28:01.750723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 85/163] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:01 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:02.774403 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fbb47ca9-3c0f-4837-a379-1896538da285 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:02.775105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fbb47ca9-3c0f-4837-a379-1896538da285 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:02.782912 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbb47ca9-3c0f-4837-a379-1896538da285 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:02.783401 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbb47ca9-3c0f-4837-a379-1896538da285 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:02.783962 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbb47ca9-3c0f-4837-a379-1896538da285 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:02.784736 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbb47ca9-3c0f-4837-a379-1896538da285 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:02.785218 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbb47ca9-3c0f-4837-a379-1896538da285 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:02.785644 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbb47ca9-3c0f-4837-a379-1896538da285 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:02.945591 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fbb47ca9-3c0f-4837-a379-1896538da285 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:02.953220 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fbb47ca9-3c0f-4837-a379-1896538da285 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.182905 Sep 15 19:28:02.953792 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 79/164] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:02 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:03.618752 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6760373c-109b-4485-87bc-167c16a986b7 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:03.619350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6760373c-109b-4485-87bc-167c16a986b7 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:03.625941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6760373c-109b-4485-87bc-167c16a986b7 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:03.626519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6760373c-109b-4485-87bc-167c16a986b7 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:03.627028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6760373c-109b-4485-87bc-167c16a986b7 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:03.627839 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6760373c-109b-4485-87bc-167c16a986b7 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:03.628367 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6760373c-109b-4485-87bc-167c16a986b7 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:03.628863 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6760373c-109b-4485-87bc-167c16a986b7 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:03.644350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-6760373c-109b-4485-87bc-167c16a986b7 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] HTTP exception thrown: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6760373c-109b-4485-87bc-167c16a986b7 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Request method failure captured: Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb HTTP/1.1 Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3xxvRw898gP3VHXT00Prpp-_wU4negdUD8awtSBAkYep2uv0E2eaUegPb_tvVhs42jx-NTefp8dqc_LmB3hygZodM3Ca7TysKefY0aOAFyO3HTZcd3Tz1PYGXUvIaZJbSjeJ7GOFZldw_83T8-hVNvAh8x-LdhZBU4Ean137bmW_Y4 Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 4a866fb1264140c1a1056696bf6fabc7 Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-DeleteServersTestJSON-1559077497 Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:28:03.645919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:28:03.648244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4a866fb1264140c1a1056696bf6fabc7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4a866fb1264140c1a1056696bf6fabc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4a866fb1264140c1a1056696bf6fabc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4a866fb1264140c1a1056696bf6fabc7"}]}] Sep 15 19:28:03.648244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-DeleteServersTestJSON-1559077497 Sep 15 19:28:03.648244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 4a866fb1264140c1a1056696bf6fabc7 Sep 15 19:28:03.648244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-DeleteServersTestJSON-1559077497 Sep 15 19:28:03.648244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-DeleteServersTestJSON-1559077497-project Sep 15 19:28:03.648244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:28:03.648244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:28:03.648244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 1ab4dbb6c98f4c99bbb06f586aaddeba Sep 15 19:28:03.648244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-DeleteServersTestJSON-1559077497-project Sep 15 19:28:03.648244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:28:03.648244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:03.648244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '49ffe7b2-9cde-408a-b314-8c18c02ca8fb'} Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:28:03.649104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:03.650150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:28:03.651254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6760373c-109b-4485-87bc-167c16a986b7 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Returning 404 to user: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:28:03.651254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6760373c-109b-4485-87bc-167c16a986b7 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "DELETE /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 404 len: 111 microversion: 2.1 time: 0.033829 Sep 15 19:28:03.651254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 86/165] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:28:03 2022] DELETE /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:28:03.656983 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7be088da-f03f-4748-b460-a94f3d65c9d6 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:03.657719 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7be088da-f03f-4748-b460-a94f3d65c9d6 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] [instance: 49ffe7b2-9cde-408a-b314-8c18c02ca8fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:03.663825 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7be088da-f03f-4748-b460-a94f3d65c9d6 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:03.664237 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7be088da-f03f-4748-b460-a94f3d65c9d6 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:03.664665 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7be088da-f03f-4748-b460-a94f3d65c9d6 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:03.665340 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7be088da-f03f-4748-b460-a94f3d65c9d6 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:03.665782 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7be088da-f03f-4748-b460-a94f3d65c9d6 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:03.666215 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7be088da-f03f-4748-b460-a94f3d65c9d6 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-7be088da-f03f-4748-b460-a94f3d65c9d6 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] HTTP exception thrown: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7be088da-f03f-4748-b460-a94f3d65c9d6 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Request method failure captured: Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb HTTP/1.1 Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Connection: close Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Host: 10.222.0.18 Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjI3xxvRw898gP3VHXT00Prpp-_wU4negdUD8awtSBAkYep2uv0E2eaUegPb_tvVhs42jx-NTefp8dqc_LmB3hygZodM3Ca7TysKefY0aOAFyO3HTZcd3Tz1PYGXUvIaZJbSjeJ7GOFZldw_83T8-hVNvAh8x-LdhZBU4Ean137bmW_Y4 Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Id: 4a866fb1264140c1a1056696bf6fabc7 Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-1559077497 Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Role: member,reader Sep 15 19:28:03.685045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Roles: member,reader Sep 15 19:28:03.686465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4a866fb1264140c1a1056696bf6fabc7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4a866fb1264140c1a1056696bf6fabc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4a866fb1264140c1a1056696bf6fabc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4a866fb1264140c1a1056696bf6fabc7"}]}] Sep 15 19:28:03.686465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-1559077497 Sep 15 19:28:03.686465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 4a866fb1264140c1a1056696bf6fabc7 Sep 15 19:28:03.686465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-1559077497 Sep 15 19:28:03.686465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-1559077497-project Sep 15 19:28:03.686465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 15 19:28:03.686465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 15 19:28:03.686465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Id: 1ab4dbb6c98f4c99bbb06f586aaddeba Sep 15 19:28:03.686465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-1559077497-project Sep 15 19:28:03.686465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: method: > Sep 15 19:28:03.686465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: exception: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:03.686465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: action_args: {'id': '49ffe7b2-9cde-408a-b314-8c18c02ca8fb'} Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:28:03.687105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. Sep 15 19:28:03.688184 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:03.689282 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7be088da-f03f-4748-b460-a94f3d65c9d6 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] Returning 404 to user: Instance 49ffe7b2-9cde-408a-b314-8c18c02ca8fb could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:28:03.689282 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7be088da-f03f-4748-b460-a94f3d65c9d6 tempest-DeleteServersTestJSON-1559077497 tempest-DeleteServersTestJSON-1559077497-project] 10.222.0.18 "GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb" status: 404 len: 111 microversion: 2.1 time: 0.030325 Sep 15 19:28:03.689282 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 80/166] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:03 2022] GET /compute/v2.1/servers/49ffe7b2-9cde-408a-b314-8c18c02ca8fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:28:03.976845 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-522381d2-af18-4f4f-82b7-e8e1ddfd761c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:03.977734 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-522381d2-af18-4f4f-82b7-e8e1ddfd761c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:03.984984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-522381d2-af18-4f4f-82b7-e8e1ddfd761c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:03.985634 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-522381d2-af18-4f4f-82b7-e8e1ddfd761c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:03.986229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-522381d2-af18-4f4f-82b7-e8e1ddfd761c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:03.987112 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-522381d2-af18-4f4f-82b7-e8e1ddfd761c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:03.987769 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-522381d2-af18-4f4f-82b7-e8e1ddfd761c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:03.988352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-522381d2-af18-4f4f-82b7-e8e1ddfd761c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:04.272927 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-522381d2-af18-4f4f-82b7-e8e1ddfd761c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:04.282449 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-522381d2-af18-4f4f-82b7-e8e1ddfd761c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.309356 Sep 15 19:28:04.283606 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 87/167] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:03 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:05.307947 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-76ce2bfb-a06b-42ab-b310-bc54827ad00f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:05.308867 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-76ce2bfb-a06b-42ab-b310-bc54827ad00f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:05.316192 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76ce2bfb-a06b-42ab-b310-bc54827ad00f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:05.316743 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76ce2bfb-a06b-42ab-b310-bc54827ad00f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:05.317197 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76ce2bfb-a06b-42ab-b310-bc54827ad00f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:05.317902 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76ce2bfb-a06b-42ab-b310-bc54827ad00f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:05.318391 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76ce2bfb-a06b-42ab-b310-bc54827ad00f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:05.318820 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76ce2bfb-a06b-42ab-b310-bc54827ad00f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:05.534165 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-76ce2bfb-a06b-42ab-b310-bc54827ad00f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:05.542302 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-76ce2bfb-a06b-42ab-b310-bc54827ad00f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.239535 Sep 15 19:28:05.543550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 81/168] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:05 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:06.565937 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-50440cfc-5a9c-42fd-8096-231120044b59 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:06.566466 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-50440cfc-5a9c-42fd-8096-231120044b59 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:06.572904 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50440cfc-5a9c-42fd-8096-231120044b59 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:06.573375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50440cfc-5a9c-42fd-8096-231120044b59 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:06.573988 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50440cfc-5a9c-42fd-8096-231120044b59 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:06.574870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50440cfc-5a9c-42fd-8096-231120044b59 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:06.575319 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50440cfc-5a9c-42fd-8096-231120044b59 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:06.575881 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50440cfc-5a9c-42fd-8096-231120044b59 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:06.719578 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-50440cfc-5a9c-42fd-8096-231120044b59 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:06.728660 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-50440cfc-5a9c-42fd-8096-231120044b59 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.166628 Sep 15 19:28:06.729232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 88/169] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:06 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:07.753000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cfd84150-8b38-48eb-87b0-2f2e4723ca9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:07.753507 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cfd84150-8b38-48eb-87b0-2f2e4723ca9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:07.763143 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfd84150-8b38-48eb-87b0-2f2e4723ca9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:07.763750 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfd84150-8b38-48eb-87b0-2f2e4723ca9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:07.764134 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfd84150-8b38-48eb-87b0-2f2e4723ca9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:07.765052 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfd84150-8b38-48eb-87b0-2f2e4723ca9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:07.765488 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfd84150-8b38-48eb-87b0-2f2e4723ca9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:07.765908 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfd84150-8b38-48eb-87b0-2f2e4723ca9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:07.954705 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-cfd84150-8b38-48eb-87b0-2f2e4723ca9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:07.965039 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cfd84150-8b38-48eb-87b0-2f2e4723ca9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.215455 Sep 15 19:28:07.984045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 82/170] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:07 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:08.989166 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c9ba80b6-89dc-4c41-b40e-4f0c88b9deb5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:08.989778 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c9ba80b6-89dc-4c41-b40e-4f0c88b9deb5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:08.996081 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c9ba80b6-89dc-4c41-b40e-4f0c88b9deb5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:08.996564 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c9ba80b6-89dc-4c41-b40e-4f0c88b9deb5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:08.997026 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c9ba80b6-89dc-4c41-b40e-4f0c88b9deb5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:08.997710 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c9ba80b6-89dc-4c41-b40e-4f0c88b9deb5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:08.998157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c9ba80b6-89dc-4c41-b40e-4f0c88b9deb5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:08.998577 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c9ba80b6-89dc-4c41-b40e-4f0c88b9deb5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:09.152019 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c9ba80b6-89dc-4c41-b40e-4f0c88b9deb5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:09.161935 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c9ba80b6-89dc-4c41-b40e-4f0c88b9deb5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.176605 Sep 15 19:28:09.162607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 89/171] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:08 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:10.185216 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11e79df6-7676-40ad-9cc8-8a2cdc495239 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:10.186154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11e79df6-7676-40ad-9cc8-8a2cdc495239 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:10.197586 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11e79df6-7676-40ad-9cc8-8a2cdc495239 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:10.197586 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11e79df6-7676-40ad-9cc8-8a2cdc495239 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:10.197586 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11e79df6-7676-40ad-9cc8-8a2cdc495239 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:10.197586 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11e79df6-7676-40ad-9cc8-8a2cdc495239 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:10.198440 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11e79df6-7676-40ad-9cc8-8a2cdc495239 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:10.198440 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11e79df6-7676-40ad-9cc8-8a2cdc495239 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:10.329161 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-11e79df6-7676-40ad-9cc8-8a2cdc495239 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:10.338175 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11e79df6-7676-40ad-9cc8-8a2cdc495239 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.156770 Sep 15 19:28:10.339203 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 83/172] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:10 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:11.361765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ec501a98-4164-4526-bc57-551f98fcf019 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:11.362543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ec501a98-4164-4526-bc57-551f98fcf019 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:11.369706 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec501a98-4164-4526-bc57-551f98fcf019 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:11.370194 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec501a98-4164-4526-bc57-551f98fcf019 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:11.370635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec501a98-4164-4526-bc57-551f98fcf019 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:11.371361 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec501a98-4164-4526-bc57-551f98fcf019 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:11.371943 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec501a98-4164-4526-bc57-551f98fcf019 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:11.372397 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec501a98-4164-4526-bc57-551f98fcf019 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:11.524011 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ec501a98-4164-4526-bc57-551f98fcf019 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:11.532461 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ec501a98-4164-4526-bc57-551f98fcf019 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.174925 Sep 15 19:28:11.533046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 90/173] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:11 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:12.558400 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eb92f8e1-9c52-4f6c-9120-5765fbf290aa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:12.559556 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eb92f8e1-9c52-4f6c-9120-5765fbf290aa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:12.565094 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb92f8e1-9c52-4f6c-9120-5765fbf290aa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:12.565543 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb92f8e1-9c52-4f6c-9120-5765fbf290aa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:12.566070 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb92f8e1-9c52-4f6c-9120-5765fbf290aa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:12.566904 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb92f8e1-9c52-4f6c-9120-5765fbf290aa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:12.567581 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb92f8e1-9c52-4f6c-9120-5765fbf290aa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:12.567724 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb92f8e1-9c52-4f6c-9120-5765fbf290aa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:12.704935 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb92f8e1-9c52-4f6c-9120-5765fbf290aa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:12.713750 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eb92f8e1-9c52-4f6c-9120-5765fbf290aa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1523 microversion: 2.1 time: 0.159775 Sep 15 19:28:12.714316 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 84/174] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:12 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:13.737840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5538e75a-455a-40a0-a54d-ff703f43b639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:13.738454 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5538e75a-455a-40a0-a54d-ff703f43b639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:13.740484 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:13.745327 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5538e75a-455a-40a0-a54d-ff703f43b639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:13.745811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5538e75a-455a-40a0-a54d-ff703f43b639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:13.746242 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5538e75a-455a-40a0-a54d-ff703f43b639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:13.757046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5538e75a-455a-40a0-a54d-ff703f43b639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:13.757046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5538e75a-455a-40a0-a54d-ff703f43b639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:13.757046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5538e75a-455a-40a0-a54d-ff703f43b639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:13.887884 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5538e75a-455a-40a0-a54d-ff703f43b639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:13.896689 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5538e75a-455a-40a0-a54d-ff703f43b639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1503 microversion: 2.1 time: 0.162139 Sep 15 19:28:13.897199 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 91/175] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:13 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:13.925452 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0bc748ef-a37e-4acc-a4b6-d4cffaae8d1a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:13.926387 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0bc748ef-a37e-4acc-a4b6-d4cffaae8d1a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:13.935423 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bc748ef-a37e-4acc-a4b6-d4cffaae8d1a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:13.935989 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bc748ef-a37e-4acc-a4b6-d4cffaae8d1a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:13.936460 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bc748ef-a37e-4acc-a4b6-d4cffaae8d1a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:13.937278 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bc748ef-a37e-4acc-a4b6-d4cffaae8d1a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:13.937769 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bc748ef-a37e-4acc-a4b6-d4cffaae8d1a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:13.938228 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bc748ef-a37e-4acc-a4b6-d4cffaae8d1a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:14.084787 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0bc748ef-a37e-4acc-a4b6-d4cffaae8d1a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:14.098281 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0bc748ef-a37e-4acc-a4b6-d4cffaae8d1a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1516 microversion: 2.1 time: 0.178085 Sep 15 19:28:14.105352 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 85/176] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:13 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:16.281878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-35d4bdaf-a01a-499c-b0dc-8c71ea8bc302 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:28:16.282473 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-35d4bdaf-a01a-499c-b0dc-8c71ea8bc302 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:16.288852 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35d4bdaf-a01a-499c-b0dc-8c71ea8bc302 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:16.289530 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35d4bdaf-a01a-499c-b0dc-8c71ea8bc302 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:16.289967 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35d4bdaf-a01a-499c-b0dc-8c71ea8bc302 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:16.290840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35d4bdaf-a01a-499c-b0dc-8c71ea8bc302 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:16.291287 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35d4bdaf-a01a-499c-b0dc-8c71ea8bc302 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:16.291731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35d4bdaf-a01a-499c-b0dc-8c71ea8bc302 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:16.337684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-35d4bdaf-a01a-499c-b0dc-8c71ea8bc302 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lazy-loading 'flavor' on Instance uuid 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:28:17.139172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-35d4bdaf-a01a-499c-b0dc-8c71ea8bc302 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "POST /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5/action" status: 200 len: 32 microversion: 2.1 time: 0.863832 Sep 15 19:28:17.149794 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 92/177] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:28:16 2022] POST /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5/action => generated 32 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 19:28:17.152441 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7483c744-5357-4975-ad3b-8e42b50234d7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:17.155023 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7483c744-5357-4975-ad3b-8e42b50234d7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:17.165252 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7483c744-5357-4975-ad3b-8e42b50234d7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:17.171352 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7483c744-5357-4975-ad3b-8e42b50234d7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:17.175760 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7483c744-5357-4975-ad3b-8e42b50234d7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:17.175760 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7483c744-5357-4975-ad3b-8e42b50234d7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:17.175760 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7483c744-5357-4975-ad3b-8e42b50234d7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:17.175760 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7483c744-5357-4975-ad3b-8e42b50234d7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:17.433660 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7483c744-5357-4975-ad3b-8e42b50234d7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:17.445736 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7483c744-5357-4975-ad3b-8e42b50234d7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.297634 Sep 15 19:28:17.446507 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 86/178] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:17 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:18.470419 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4762c634-e99b-434f-af33-0feeec987d77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:18.471160 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4762c634-e99b-434f-af33-0feeec987d77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:18.478731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4762c634-e99b-434f-af33-0feeec987d77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:18.479602 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4762c634-e99b-434f-af33-0feeec987d77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:18.480076 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4762c634-e99b-434f-af33-0feeec987d77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:18.480783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4762c634-e99b-434f-af33-0feeec987d77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:18.481237 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4762c634-e99b-434f-af33-0feeec987d77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:18.481662 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4762c634-e99b-434f-af33-0feeec987d77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:18.627132 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4762c634-e99b-434f-af33-0feeec987d77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:18.635761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4762c634-e99b-434f-af33-0feeec987d77 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.169613 Sep 15 19:28:18.636348 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 93/179] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:18 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:19.645086 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4afec3f7-7067-49a3-bbc8-bc689b0130ef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Action: 'create', calling method: .version_select at 0x7f551ecdc040>, body: {"keypair": {"name": "tempest-keypair-154239194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcNTJXviTUQHCcqj+uKPlVqB2NnEvDHRQmP2h2GDE9AaEcClWjxvr90kUiyPPrfftqa1gEJNpgWCFvbzQg+POsRPnGkCL1k6G54IW0TET7DI9zJqEyLGPoOYK+Dt8Bcsg=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:28:19.660076 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a516a7cd-c0ac-4be4-b4a4-0412962eaa4c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:19.660719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a516a7cd-c0ac-4be4-b4a4-0412962eaa4c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:19.667268 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a516a7cd-c0ac-4be4-b4a4-0412962eaa4c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:19.668012 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a516a7cd-c0ac-4be4-b4a4-0412962eaa4c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:19.668600 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a516a7cd-c0ac-4be4-b4a4-0412962eaa4c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:19.675810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a516a7cd-c0ac-4be4-b4a4-0412962eaa4c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:19.675810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a516a7cd-c0ac-4be4-b4a4-0412962eaa4c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:19.675810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a516a7cd-c0ac-4be4-b4a4-0412962eaa4c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:19.676112 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-4afec3f7-7067-49a3-bbc8-bc689b0130ef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Getting quotas for project 340975b28fc242b5bf4a3364fe702ad4. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:28:19.676112 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-4afec3f7-7067-49a3-bbc8-bc689b0130ef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Getting quotas for user cfbdd49e2fa64b428d957d9dcf1d6846 and project 340975b28fc242b5bf4a3364fe702ad4. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:28:19.813509 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a516a7cd-c0ac-4be4-b4a4-0412962eaa4c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:19.832172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a516a7cd-c0ac-4be4-b4a4-0412962eaa4c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.166238 Sep 15 19:28:19.832172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 94/180] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:19 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:19.898537 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4afec3f7-7067-49a3-bbc8-bc689b0130ef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.402230 Sep 15 19:28:19.899160 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 87/181] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 15 19:28:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:28:20.849914 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f3ea8338-3073-47d7-baaf-363d06543877 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:20.851304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f3ea8338-3073-47d7-baaf-363d06543877 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:20.861970 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3ea8338-3073-47d7-baaf-363d06543877 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:20.862659 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3ea8338-3073-47d7-baaf-363d06543877 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:20.863269 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3ea8338-3073-47d7-baaf-363d06543877 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:20.864708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3ea8338-3073-47d7-baaf-363d06543877 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:20.866362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3ea8338-3073-47d7-baaf-363d06543877 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:20.867383 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3ea8338-3073-47d7-baaf-363d06543877 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:21.015392 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f3ea8338-3073-47d7-baaf-363d06543877 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:21.039967 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f3ea8338-3073-47d7-baaf-363d06543877 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.185076 Sep 15 19:28:21.039967 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 95/182] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:20 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:22.070255 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7d5eaaa8-bbec-4368-98b3-91cd6d6d28b0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:22.071341 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7d5eaaa8-bbec-4368-98b3-91cd6d6d28b0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:22.095098 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:22.096778 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5eaaa8-bbec-4368-98b3-91cd6d6d28b0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:22.097454 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5eaaa8-bbec-4368-98b3-91cd6d6d28b0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:22.097918 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5eaaa8-bbec-4368-98b3-91cd6d6d28b0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:22.098640 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5eaaa8-bbec-4368-98b3-91cd6d6d28b0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:22.099107 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5eaaa8-bbec-4368-98b3-91cd6d6d28b0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:22.099804 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5eaaa8-bbec-4368-98b3-91cd6d6d28b0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:22.472075 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d5eaaa8-bbec-4368-98b3-91cd6d6d28b0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:22.496668 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7d5eaaa8-bbec-4368-98b3-91cd6d6d28b0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.440391 Sep 15 19:28:22.497161 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 88/183] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:22 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:23.520283 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b7eed1be-d0ca-4a37-972f-85571cc972a0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:23.520895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b7eed1be-d0ca-4a37-972f-85571cc972a0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:23.527912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7eed1be-d0ca-4a37-972f-85571cc972a0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:23.528490 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7eed1be-d0ca-4a37-972f-85571cc972a0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:23.528984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7eed1be-d0ca-4a37-972f-85571cc972a0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:23.529978 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7eed1be-d0ca-4a37-972f-85571cc972a0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:23.530496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7eed1be-d0ca-4a37-972f-85571cc972a0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:23.530986 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7eed1be-d0ca-4a37-972f-85571cc972a0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:23.763257 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b7eed1be-d0ca-4a37-972f-85571cc972a0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:23.771256 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b7eed1be-d0ca-4a37-972f-85571cc972a0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.254833 Sep 15 19:28:23.772019 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 96/184] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:23 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:24.146838 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1419568918", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6260c8ac-0673-45b5-914a-caba360d68d4"}], "security_groups": [{"name": "tempest-securitygroup--1568958743"}], "key_name": "tempest-keypair-154239194", "user_data": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:28:24.266516 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] validate_networks() for [('6260c8ac-0673-45b5-914a-caba360d68d4', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:28:24.721028 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:28:24.721452 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:28:24.721928 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:28:24.722361 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:28:24.722767 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:28:24.732069 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:24.732533 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:24.732964 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:24.733727 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:24.734177 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:24.734628 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:24.752317 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Getting quotas for project 340975b28fc242b5bf4a3364fe702ad4. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:28:24.756319 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Getting quotas for user cfbdd49e2fa64b428d957d9dcf1d6846 and project 340975b28fc242b5bf4a3364fe702ad4. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:28:24.767681 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:28:24.770027 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:28:24.797522 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e14a32dc-817a-414c-9237-deb098968738 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:24.797522 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e14a32dc-817a-414c-9237-deb098968738 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:24.801481 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e14a32dc-817a-414c-9237-deb098968738 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:24.801992 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e14a32dc-817a-414c-9237-deb098968738 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:24.802519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e14a32dc-817a-414c-9237-deb098968738 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:24.803123 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e14a32dc-817a-414c-9237-deb098968738 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:24.804152 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e14a32dc-817a-414c-9237-deb098968738 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:24.804839 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e14a32dc-817a-414c-9237-deb098968738 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:24.992131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e14a32dc-817a-414c-9237-deb098968738 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:25.000141 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e14a32dc-817a-414c-9237-deb098968738 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.209086 Sep 15 19:28:25.015774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 97/185] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:24 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:25.122888 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-673934b0-04a1-4b0e-8039-c26159f46baa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.980649 Sep 15 19:28:25.123567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 89/186] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:28:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 19:28:25.135036 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-672a234b-0f05-4128-b730-c439e61d13c5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:25.135656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-672a234b-0f05-4128-b730-c439e61d13c5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:25.194660 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-672a234b-0f05-4128-b730-c439e61d13c5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:25.202467 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-672a234b-0f05-4128-b730-c439e61d13c5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1237 microversion: 2.1 time: 0.071249 Sep 15 19:28:25.208072 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 98/187] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:25 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:26.026684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-24a8f64f-5372-477d-af49-da8b7eff4375 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:26.027308 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-24a8f64f-5372-477d-af49-da8b7eff4375 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:26.034258 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a8f64f-5372-477d-af49-da8b7eff4375 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:26.034437 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a8f64f-5372-477d-af49-da8b7eff4375 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:26.034871 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a8f64f-5372-477d-af49-da8b7eff4375 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:26.035592 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a8f64f-5372-477d-af49-da8b7eff4375 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:26.036074 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a8f64f-5372-477d-af49-da8b7eff4375 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:26.036492 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a8f64f-5372-477d-af49-da8b7eff4375 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:26.181453 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-24a8f64f-5372-477d-af49-da8b7eff4375 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:26.190416 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-24a8f64f-5372-477d-af49-da8b7eff4375 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.168851 Sep 15 19:28:26.194583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 90/188] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:26 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:26.231033 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a2f1966b-4824-4d4a-bfdd-745277359d7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:26.231698 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a2f1966b-4824-4d4a-bfdd-745277359d7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:26.286341 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a2f1966b-4824-4d4a-bfdd-745277359d7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:26.294408 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a2f1966b-4824-4d4a-bfdd-745277359d7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1237 microversion: 2.1 time: 0.067486 Sep 15 19:28:26.295392 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 99/189] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:26 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:27.215374 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e38544b2-9b1d-430a-8a1f-9c56bae42e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:27.216154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e38544b2-9b1d-430a-8a1f-9c56bae42e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:27.224308 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e38544b2-9b1d-430a-8a1f-9c56bae42e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:27.227866 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e38544b2-9b1d-430a-8a1f-9c56bae42e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:27.227866 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e38544b2-9b1d-430a-8a1f-9c56bae42e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:27.227866 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e38544b2-9b1d-430a-8a1f-9c56bae42e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:27.227866 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e38544b2-9b1d-430a-8a1f-9c56bae42e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:27.228338 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e38544b2-9b1d-430a-8a1f-9c56bae42e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:27.319501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-14e9f964-0a4e-4fa6-b20b-6497817fbb7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:27.320267 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-14e9f964-0a4e-4fa6-b20b-6497817fbb7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:27.326755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14e9f964-0a4e-4fa6-b20b-6497817fbb7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:27.327232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14e9f964-0a4e-4fa6-b20b-6497817fbb7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:27.330002 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14e9f964-0a4e-4fa6-b20b-6497817fbb7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:27.330763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14e9f964-0a4e-4fa6-b20b-6497817fbb7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:27.331526 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14e9f964-0a4e-4fa6-b20b-6497817fbb7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:27.331942 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14e9f964-0a4e-4fa6-b20b-6497817fbb7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:27.376206 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e38544b2-9b1d-430a-8a1f-9c56bae42e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:27.387471 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e38544b2-9b1d-430a-8a1f-9c56bae42e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.176345 Sep 15 19:28:27.397551 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 91/190] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:27 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:27.411892 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-14e9f964-0a4e-4fa6-b20b-6497817fbb7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:27.417154 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-14e9f964-0a4e-4fa6-b20b-6497817fbb7f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1241 microversion: 2.1 time: 0.101858 Sep 15 19:28:27.417771 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 100/191] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:27 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:28.411632 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d50263a-aee4-4067-a36d-1546ff4a1259 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:28.412278 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4d50263a-aee4-4067-a36d-1546ff4a1259 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:28.419564 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d50263a-aee4-4067-a36d-1546ff4a1259 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:28.420097 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d50263a-aee4-4067-a36d-1546ff4a1259 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:28.420537 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d50263a-aee4-4067-a36d-1546ff4a1259 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:28.421264 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d50263a-aee4-4067-a36d-1546ff4a1259 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:28.421717 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d50263a-aee4-4067-a36d-1546ff4a1259 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:28.422142 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d50263a-aee4-4067-a36d-1546ff4a1259 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:28.441798 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d93f448d-804e-44f0-bad1-e964eb16eb66 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:28.442405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d93f448d-804e-44f0-bad1-e964eb16eb66 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:28.449519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d93f448d-804e-44f0-bad1-e964eb16eb66 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:28.450072 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d93f448d-804e-44f0-bad1-e964eb16eb66 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:28.450505 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d93f448d-804e-44f0-bad1-e964eb16eb66 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:28.451204 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d93f448d-804e-44f0-bad1-e964eb16eb66 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:28.451681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d93f448d-804e-44f0-bad1-e964eb16eb66 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:28.452126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d93f448d-804e-44f0-bad1-e964eb16eb66 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:28.517745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d93f448d-804e-44f0-bad1-e964eb16eb66 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:28.521528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:28.526331 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d93f448d-804e-44f0-bad1-e964eb16eb66 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1289 microversion: 2.1 time: 0.088736 Sep 15 19:28:28.527295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 101/192] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:28 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:28.568678 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d50263a-aee4-4067-a36d-1546ff4a1259 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:28.577141 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d50263a-aee4-4067-a36d-1546ff4a1259 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.169512 Sep 15 19:28:28.577671 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 92/193] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:28 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:29.550600 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3dc2dad4-fc6c-4d14-be08-c9a84e479422 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:29.551210 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3dc2dad4-fc6c-4d14-be08-c9a84e479422 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:29.558672 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3dc2dad4-fc6c-4d14-be08-c9a84e479422 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:29.559458 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3dc2dad4-fc6c-4d14-be08-c9a84e479422 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:29.559942 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3dc2dad4-fc6c-4d14-be08-c9a84e479422 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:29.560782 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3dc2dad4-fc6c-4d14-be08-c9a84e479422 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:29.561237 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3dc2dad4-fc6c-4d14-be08-c9a84e479422 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:29.561735 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3dc2dad4-fc6c-4d14-be08-c9a84e479422 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:29.600942 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e72389d-0893-4ab7-ad59-29b2e8be09c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:29.601550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6e72389d-0893-4ab7-ad59-29b2e8be09c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:29.608322 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e72389d-0893-4ab7-ad59-29b2e8be09c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:29.608799 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e72389d-0893-4ab7-ad59-29b2e8be09c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:29.609228 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e72389d-0893-4ab7-ad59-29b2e8be09c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:29.609921 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e72389d-0893-4ab7-ad59-29b2e8be09c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:29.610364 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e72389d-0893-4ab7-ad59-29b2e8be09c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:29.610782 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e72389d-0893-4ab7-ad59-29b2e8be09c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:29.644690 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3dc2dad4-fc6c-4d14-be08-c9a84e479422 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:29.653044 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3dc2dad4-fc6c-4d14-be08-c9a84e479422 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1297 microversion: 2.1 time: 0.106392 Sep 15 19:28:29.653774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 102/194] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:29 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:29.822639 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6e72389d-0893-4ab7-ad59-29b2e8be09c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:29.830445 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6e72389d-0893-4ab7-ad59-29b2e8be09c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.233275 Sep 15 19:28:29.831018 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 93/195] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:29 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:30.677263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cda25e39-91ab-4499-9183-144f86b5ee8a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:30.677920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cda25e39-91ab-4499-9183-144f86b5ee8a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:30.689596 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cda25e39-91ab-4499-9183-144f86b5ee8a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:30.689718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cda25e39-91ab-4499-9183-144f86b5ee8a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:30.690250 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cda25e39-91ab-4499-9183-144f86b5ee8a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:30.691192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cda25e39-91ab-4499-9183-144f86b5ee8a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:30.692025 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cda25e39-91ab-4499-9183-144f86b5ee8a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:30.692916 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cda25e39-91ab-4499-9183-144f86b5ee8a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:30.853885 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7988065a-f49b-46f5-8e43-538ed9088e3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:30.854717 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7988065a-f49b-46f5-8e43-538ed9088e3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:30.864609 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7988065a-f49b-46f5-8e43-538ed9088e3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:30.865552 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7988065a-f49b-46f5-8e43-538ed9088e3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:30.866229 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7988065a-f49b-46f5-8e43-538ed9088e3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:30.867637 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7988065a-f49b-46f5-8e43-538ed9088e3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:30.868541 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7988065a-f49b-46f5-8e43-538ed9088e3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:30.869124 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7988065a-f49b-46f5-8e43-538ed9088e3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:30.909847 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cda25e39-91ab-4499-9183-144f86b5ee8a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:30.928357 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cda25e39-91ab-4499-9183-144f86b5ee8a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1363 microversion: 2.1 time: 0.255561 Sep 15 19:28:30.934309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 103/196] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:30 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:31.046818 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7988065a-f49b-46f5-8e43-538ed9088e3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:31.056425 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7988065a-f49b-46f5-8e43-538ed9088e3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.206678 Sep 15 19:28:31.068596 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 94/197] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:30 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:31.953731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f629adf3-d281-4376-a14e-f62a8b31af31 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:31.954344 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f629adf3-d281-4376-a14e-f62a8b31af31 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:31.960418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f629adf3-d281-4376-a14e-f62a8b31af31 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:31.960895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f629adf3-d281-4376-a14e-f62a8b31af31 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:31.961329 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f629adf3-d281-4376-a14e-f62a8b31af31 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:31.962132 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f629adf3-d281-4376-a14e-f62a8b31af31 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:31.962580 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f629adf3-d281-4376-a14e-f62a8b31af31 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:31.963000 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f629adf3-d281-4376-a14e-f62a8b31af31 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:32.080487 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9effdb54-6af0-422e-9644-50b7b67ff987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:32.081900 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9effdb54-6af0-422e-9644-50b7b67ff987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:32.088526 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9effdb54-6af0-422e-9644-50b7b67ff987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:32.089219 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9effdb54-6af0-422e-9644-50b7b67ff987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:32.089658 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9effdb54-6af0-422e-9644-50b7b67ff987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:32.090523 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9effdb54-6af0-422e-9644-50b7b67ff987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:32.090973 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9effdb54-6af0-422e-9644-50b7b67ff987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:32.091565 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9effdb54-6af0-422e-9644-50b7b67ff987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:32.134706 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f629adf3-d281-4376-a14e-f62a8b31af31 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:32.144558 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f629adf3-d281-4376-a14e-f62a8b31af31 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1363 microversion: 2.1 time: 0.194517 Sep 15 19:28:32.145267 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 104/198] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:31 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:32.257885 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9effdb54-6af0-422e-9644-50b7b67ff987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:32.274682 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9effdb54-6af0-422e-9644-50b7b67ff987 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.197892 Sep 15 19:28:32.275496 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 95/199] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:32 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:33.166437 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3eee48e8-b164-4919-b0ef-974863a97e71 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:33.167050 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3eee48e8-b164-4919-b0ef-974863a97e71 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:33.173664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3eee48e8-b164-4919-b0ef-974863a97e71 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:33.174150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3eee48e8-b164-4919-b0ef-974863a97e71 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:33.174577 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3eee48e8-b164-4919-b0ef-974863a97e71 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:33.175255 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3eee48e8-b164-4919-b0ef-974863a97e71 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:33.175724 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3eee48e8-b164-4919-b0ef-974863a97e71 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:33.176139 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3eee48e8-b164-4919-b0ef-974863a97e71 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:33.300071 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d588997a-213f-42ee-847c-2cdfe8582b1a req-ea888e04-12fc-4f34-a456-505d063f381b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ddcd684-503e-4123-9078-c4821c63519f", "tag": "83b9862f-0442-4819-8455-b738ec1a0232"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:28:33.311457 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d588997a-213f-42ee-847c-2cdfe8582b1a req-ea888e04-12fc-4f34-a456-505d063f381b service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:33.311964 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d588997a-213f-42ee-847c-2cdfe8582b1a req-ea888e04-12fc-4f34-a456-505d063f381b service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:33.312400 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d588997a-213f-42ee-847c-2cdfe8582b1a req-ea888e04-12fc-4f34-a456-505d063f381b service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:33.345449 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-d588997a-213f-42ee-847c-2cdfe8582b1a req-ea888e04-12fc-4f34-a456-505d063f381b service nova] Creating event network-changed:83b9862f-0442-4819-8455-b738ec1a0232 for instance 8ddcd684-503e-4123-9078-c4821c63519f on hv-cinder-84984 Sep 15 19:28:33.352797 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d588997a-213f-42ee-847c-2cdfe8582b1a req-ea888e04-12fc-4f34-a456-505d063f381b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060277 Sep 15 19:28:33.353432 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 96/200] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:28:33.359926 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aaabb8a3-cdf8-42c5-9827-430daf01e80e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:33.360974 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aaabb8a3-cdf8-42c5-9827-430daf01e80e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:33.368044 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaabb8a3-cdf8-42c5-9827-430daf01e80e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:33.368531 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaabb8a3-cdf8-42c5-9827-430daf01e80e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:33.368973 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaabb8a3-cdf8-42c5-9827-430daf01e80e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:33.370087 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaabb8a3-cdf8-42c5-9827-430daf01e80e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:33.370542 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaabb8a3-cdf8-42c5-9827-430daf01e80e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:33.371157 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaabb8a3-cdf8-42c5-9827-430daf01e80e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:33.376806 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:33.397649 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3eee48e8-b164-4919-b0ef-974863a97e71 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:33.424540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3eee48e8-b164-4919-b0ef-974863a97e71 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1363 microversion: 2.1 time: 0.261786 Sep 15 19:28:33.425073 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 105/201] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:33 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:33.518754 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-aaabb8a3-cdf8-42c5-9827-430daf01e80e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:33.527167 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aaabb8a3-cdf8-42c5-9827-430daf01e80e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.172319 Sep 15 19:28:33.527821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 97/202] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:33 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:34.449107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-00a68de0-243b-411f-9f9d-ab8078314cba tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:34.450477 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-00a68de0-243b-411f-9f9d-ab8078314cba tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:34.457144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00a68de0-243b-411f-9f9d-ab8078314cba tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:34.457744 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00a68de0-243b-411f-9f9d-ab8078314cba tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:34.458253 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00a68de0-243b-411f-9f9d-ab8078314cba tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:34.459103 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00a68de0-243b-411f-9f9d-ab8078314cba tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:34.459756 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00a68de0-243b-411f-9f9d-ab8078314cba tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:34.460244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00a68de0-243b-411f-9f9d-ab8078314cba tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:34.552152 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-44825978-aee5-4816-9255-077824c937e9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:34.552768 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-44825978-aee5-4816-9255-077824c937e9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:34.559512 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44825978-aee5-4816-9255-077824c937e9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:34.560046 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44825978-aee5-4816-9255-077824c937e9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:34.560465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44825978-aee5-4816-9255-077824c937e9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:34.561160 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44825978-aee5-4816-9255-077824c937e9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:34.561610 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44825978-aee5-4816-9255-077824c937e9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:34.562034 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44825978-aee5-4816-9255-077824c937e9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:34.598145 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-00a68de0-243b-411f-9f9d-ab8078314cba tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:34.606083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-00a68de0-243b-411f-9f9d-ab8078314cba tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1363 microversion: 2.1 time: 0.161994 Sep 15 19:28:34.606951 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 106/203] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:34 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:34.742897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:34.763322 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=10 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:35.001095 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-44825978-aee5-4816-9255-077824c937e9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:35.015465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-44825978-aee5-4816-9255-077824c937e9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.466472 Sep 15 19:28:35.016178 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 98/204] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:34 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:35.630776 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4e3bcc0f-2a0b-4890-83d3-eed3f15640fa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:35.631328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4e3bcc0f-2a0b-4890-83d3-eed3f15640fa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:35.637674 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4e3bcc0f-2a0b-4890-83d3-eed3f15640fa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:35.638150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4e3bcc0f-2a0b-4890-83d3-eed3f15640fa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:35.638585 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4e3bcc0f-2a0b-4890-83d3-eed3f15640fa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:35.639276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4e3bcc0f-2a0b-4890-83d3-eed3f15640fa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:35.639743 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4e3bcc0f-2a0b-4890-83d3-eed3f15640fa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:35.640164 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4e3bcc0f-2a0b-4890-83d3-eed3f15640fa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:35.780294 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4e3bcc0f-2a0b-4890-83d3-eed3f15640fa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:35.788032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4e3bcc0f-2a0b-4890-83d3-eed3f15640fa tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1363 microversion: 2.1 time: 0.161556 Sep 15 19:28:35.788602 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 107/205] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:35 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:36.039406 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4becb790-4903-41f4-84c3-dddab6ca774d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:36.040052 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4becb790-4903-41f4-84c3-dddab6ca774d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:36.046990 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4becb790-4903-41f4-84c3-dddab6ca774d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:36.047484 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4becb790-4903-41f4-84c3-dddab6ca774d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:36.047943 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4becb790-4903-41f4-84c3-dddab6ca774d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:36.048755 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4becb790-4903-41f4-84c3-dddab6ca774d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:36.049207 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4becb790-4903-41f4-84c3-dddab6ca774d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:36.049629 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4becb790-4903-41f4-84c3-dddab6ca774d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:36.287417 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4becb790-4903-41f4-84c3-dddab6ca774d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:36.295963 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4becb790-4903-41f4-84c3-dddab6ca774d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.260993 Sep 15 19:28:36.296548 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 99/206] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:36 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:36.356057 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cf4cc4b7-ed37-4153-b864-727c58398922 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:36.356555 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cf4cc4b7-ed37-4153-b864-727c58398922 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:36.362454 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=4 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:36.364588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf4cc4b7-ed37-4153-b864-727c58398922 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:36.365132 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf4cc4b7-ed37-4153-b864-727c58398922 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:36.365842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf4cc4b7-ed37-4153-b864-727c58398922 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:36.366500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf4cc4b7-ed37-4153-b864-727c58398922 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:36.367452 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf4cc4b7-ed37-4153-b864-727c58398922 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:36.367903 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf4cc4b7-ed37-4153-b864-727c58398922 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:36.410517 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cf4cc4b7-ed37-4153-b864-727c58398922 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/ips" status: 200 len: 149 microversion: 2.1 time: 0.058425 Sep 15 19:28:36.414933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 108/207] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 15 19:28:36 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/ips => generated 149 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:28:36.811308 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1f33095-a82c-493c-9036-e981d65906a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:36.812128 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b1f33095-a82c-493c-9036-e981d65906a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:36.818847 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1f33095-a82c-493c-9036-e981d65906a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:36.819706 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1f33095-a82c-493c-9036-e981d65906a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:36.820161 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1f33095-a82c-493c-9036-e981d65906a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:36.821968 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1f33095-a82c-493c-9036-e981d65906a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:36.822605 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1f33095-a82c-493c-9036-e981d65906a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:36.823185 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1f33095-a82c-493c-9036-e981d65906a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:37.216584 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b1f33095-a82c-493c-9036-e981d65906a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:37.228723 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b1f33095-a82c-493c-9036-e981d65906a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1363 microversion: 2.1 time: 0.420635 Sep 15 19:28:37.229614 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 100/208] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:36 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:37.321793 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-14483349-8819-415c-a424-0150f3374f33 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:37.323270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-14483349-8819-415c-a424-0150f3374f33 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:37.330309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14483349-8819-415c-a424-0150f3374f33 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:37.333209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14483349-8819-415c-a424-0150f3374f33 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:37.336657 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14483349-8819-415c-a424-0150f3374f33 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:37.339102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14483349-8819-415c-a424-0150f3374f33 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:37.340279 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14483349-8819-415c-a424-0150f3374f33 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:37.340721 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14483349-8819-415c-a424-0150f3374f33 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:37.552635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-14483349-8819-415c-a424-0150f3374f33 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:37.568350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-14483349-8819-415c-a424-0150f3374f33 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.250795 Sep 15 19:28:37.569309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 109/209] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:37 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:38.139328 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d28c5bc4-8e49-4370-b916-c1e72a0f2eee req-f9374bcf-8f06-4250-8b52-641c7a402786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddcd684-503e-4123-9078-c4821c63519f", "name": "network-vif-plugged", "status": "completed", "tag": "83b9862f-0442-4819-8455-b738ec1a0232"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:28:38.159273 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d28c5bc4-8e49-4370-b916-c1e72a0f2eee req-f9374bcf-8f06-4250-8b52-641c7a402786 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:38.160141 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d28c5bc4-8e49-4370-b916-c1e72a0f2eee req-f9374bcf-8f06-4250-8b52-641c7a402786 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:38.162811 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d28c5bc4-8e49-4370-b916-c1e72a0f2eee req-f9374bcf-8f06-4250-8b52-641c7a402786 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:38.178473 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-d28c5bc4-8e49-4370-b916-c1e72a0f2eee req-f9374bcf-8f06-4250-8b52-641c7a402786 service nova] Creating event network-vif-plugged:83b9862f-0442-4819-8455-b738ec1a0232 for instance 8ddcd684-503e-4123-9078-c4821c63519f on hv-cinder-84984 Sep 15 19:28:38.185476 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d28c5bc4-8e49-4370-b916-c1e72a0f2eee req-f9374bcf-8f06-4250-8b52-641c7a402786 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049729 Sep 15 19:28:38.190221 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 101/210] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:28:38.263715 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-907aedfb-dd4a-4196-beed-03e10a7e389e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:38.265609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-907aedfb-dd4a-4196-beed-03e10a7e389e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:38.273882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-907aedfb-dd4a-4196-beed-03e10a7e389e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:38.275594 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-907aedfb-dd4a-4196-beed-03e10a7e389e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:38.276415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-907aedfb-dd4a-4196-beed-03e10a7e389e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:38.277571 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-907aedfb-dd4a-4196-beed-03e10a7e389e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:38.278279 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-907aedfb-dd4a-4196-beed-03e10a7e389e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:38.278914 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-907aedfb-dd4a-4196-beed-03e10a7e389e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:38.526274 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-907aedfb-dd4a-4196-beed-03e10a7e389e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:38.535849 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-907aedfb-dd4a-4196-beed-03e10a7e389e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1363 microversion: 2.1 time: 0.281703 Sep 15 19:28:38.537832 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 110/211] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:38 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:38.594708 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af4f8e95-2b66-4007-a0b8-e3720ca5755e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:38.595544 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af4f8e95-2b66-4007-a0b8-e3720ca5755e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:38.602628 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af4f8e95-2b66-4007-a0b8-e3720ca5755e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:38.603125 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af4f8e95-2b66-4007-a0b8-e3720ca5755e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:38.603592 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af4f8e95-2b66-4007-a0b8-e3720ca5755e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:38.604366 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af4f8e95-2b66-4007-a0b8-e3720ca5755e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:38.604973 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af4f8e95-2b66-4007-a0b8-e3720ca5755e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:38.605547 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af4f8e95-2b66-4007-a0b8-e3720ca5755e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:38.711660 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a21cab42-9774-4a03-a5e5-52d7179b4821 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "587d0a48-7e8f-4c25-a578-122ae49c3091"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:28:38.714098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a21cab42-9774-4a03-a5e5-52d7179b4821 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:38.722082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a21cab42-9774-4a03-a5e5-52d7179b4821 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:38.723071 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a21cab42-9774-4a03-a5e5-52d7179b4821 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:38.723974 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a21cab42-9774-4a03-a5e5-52d7179b4821 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:38.724955 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a21cab42-9774-4a03-a5e5-52d7179b4821 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:38.725627 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a21cab42-9774-4a03-a5e5-52d7179b4821 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:38.726854 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a21cab42-9774-4a03-a5e5-52d7179b4821 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:39.093518 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-af4f8e95-2b66-4007-a0b8-e3720ca5755e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:39.106522 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af4f8e95-2b66-4007-a0b8-e3720ca5755e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.517746 Sep 15 19:28:39.107831 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 102/212] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:38 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:39.567637 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3ecae777-1149-4929-8241-a8f6ced6d19b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:39.569108 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3ecae777-1149-4929-8241-a8f6ced6d19b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:39.579180 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ecae777-1149-4929-8241-a8f6ced6d19b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:39.579953 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ecae777-1149-4929-8241-a8f6ced6d19b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:39.580460 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ecae777-1149-4929-8241-a8f6ced6d19b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:39.581455 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ecae777-1149-4929-8241-a8f6ced6d19b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:39.582078 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ecae777-1149-4929-8241-a8f6ced6d19b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:39.582514 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ecae777-1149-4929-8241-a8f6ced6d19b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:39.862973 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3ecae777-1149-4929-8241-a8f6ced6d19b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:39.888975 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3ecae777-1149-4929-8241-a8f6ced6d19b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1363 microversion: 2.1 time: 0.327283 Sep 15 19:28:39.890583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 103/213] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:39 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:39.984868 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a21cab42-9774-4a03-a5e5-52d7179b4821 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "POST /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.275584 Sep 15 19:28:39.988719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 111/214] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:28:38 2022] POST /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments => generated 194 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:28:40.130263 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c9549fd8-597a-413d-82f4-1a4b77f1cbf3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:40.130868 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c9549fd8-597a-413d-82f4-1a4b77f1cbf3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:40.145301 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9549fd8-597a-413d-82f4-1a4b77f1cbf3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:40.145301 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9549fd8-597a-413d-82f4-1a4b77f1cbf3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:40.145301 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9549fd8-597a-413d-82f4-1a4b77f1cbf3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:40.145301 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9549fd8-597a-413d-82f4-1a4b77f1cbf3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:40.146366 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9549fd8-597a-413d-82f4-1a4b77f1cbf3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:40.147593 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9549fd8-597a-413d-82f4-1a4b77f1cbf3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:40.325547 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c9549fd8-597a-413d-82f4-1a4b77f1cbf3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:40.335946 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c9549fd8-597a-413d-82f4-1a4b77f1cbf3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.209352 Sep 15 19:28:40.336547 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 104/215] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:40 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:40.935919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e66d1e25-465c-4b80-a7fd-38143c6847d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:40.936907 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e66d1e25-465c-4b80-a7fd-38143c6847d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:40.949591 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e66d1e25-465c-4b80-a7fd-38143c6847d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:40.950392 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e66d1e25-465c-4b80-a7fd-38143c6847d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:40.951094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e66d1e25-465c-4b80-a7fd-38143c6847d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:40.953372 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e66d1e25-465c-4b80-a7fd-38143c6847d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:40.954312 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e66d1e25-465c-4b80-a7fd-38143c6847d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:40.955571 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e66d1e25-465c-4b80-a7fd-38143c6847d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:41.359480 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-31036f2c-c1ca-4036-b196-28bb00f7ecc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:41.360763 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-31036f2c-c1ca-4036-b196-28bb00f7ecc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:41.367925 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31036f2c-c1ca-4036-b196-28bb00f7ecc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:41.368070 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31036f2c-c1ca-4036-b196-28bb00f7ecc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:41.378713 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31036f2c-c1ca-4036-b196-28bb00f7ecc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:41.379483 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31036f2c-c1ca-4036-b196-28bb00f7ecc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:41.380285 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31036f2c-c1ca-4036-b196-28bb00f7ecc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:41.380687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31036f2c-c1ca-4036-b196-28bb00f7ecc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:41.545141 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e66d1e25-465c-4b80-a7fd-38143c6847d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:41.558111 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e66d1e25-465c-4b80-a7fd-38143c6847d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1549 microversion: 2.1 time: 0.635516 Sep 15 19:28:41.572368 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 112/216] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:40 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1549 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:41.585243 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9c5b1627-9f40-41d5-86c8-25271d89f8d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:41.586095 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9c5b1627-9f40-41d5-86c8-25271d89f8d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:41.602848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c5b1627-9f40-41d5-86c8-25271d89f8d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:41.603350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c5b1627-9f40-41d5-86c8-25271d89f8d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:41.603822 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c5b1627-9f40-41d5-86c8-25271d89f8d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:41.614569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-31036f2c-c1ca-4036-b196-28bb00f7ecc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:41.617553 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c5b1627-9f40-41d5-86c8-25271d89f8d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:41.618192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c5b1627-9f40-41d5-86c8-25271d89f8d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:41.620037 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c5b1627-9f40-41d5-86c8-25271d89f8d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:41.636904 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-31036f2c-c1ca-4036-b196-28bb00f7ecc5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.278630 Sep 15 19:28:41.637659 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 105/217] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:41 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:41.811254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9c5b1627-9f40-41d5-86c8-25271d89f8d7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.230211 Sep 15 19:28:41.811978 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 113/218] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 15 19:28:41 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:28:42.665531 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-13d3f62b-3da9-46cd-8b3d-0ee799a8ca9b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:42.666081 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-13d3f62b-3da9-46cd-8b3d-0ee799a8ca9b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:42.682973 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13d3f62b-3da9-46cd-8b3d-0ee799a8ca9b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:42.688378 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13d3f62b-3da9-46cd-8b3d-0ee799a8ca9b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:42.689194 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13d3f62b-3da9-46cd-8b3d-0ee799a8ca9b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:42.692888 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13d3f62b-3da9-46cd-8b3d-0ee799a8ca9b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:42.693833 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13d3f62b-3da9-46cd-8b3d-0ee799a8ca9b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:42.695945 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13d3f62b-3da9-46cd-8b3d-0ee799a8ca9b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:43.150448 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-13d3f62b-3da9-46cd-8b3d-0ee799a8ca9b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:43.159621 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-13d3f62b-3da9-46cd-8b3d-0ee799a8ca9b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.498381 Sep 15 19:28:43.161339 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 106/219] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:42 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:43.968858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-3d6186fc-5eb8-4f5a-a1eb-df8e8e2c2bcc req-638e27c6-93ee-4d0c-9511-9d8a876e12f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ddcd684-503e-4123-9078-c4821c63519f", "tag": "83b9862f-0442-4819-8455-b738ec1a0232"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:28:44.009573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-3d6186fc-5eb8-4f5a-a1eb-df8e8e2c2bcc req-638e27c6-93ee-4d0c-9511-9d8a876e12f6 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:44.014458 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-3d6186fc-5eb8-4f5a-a1eb-df8e8e2c2bcc req-638e27c6-93ee-4d0c-9511-9d8a876e12f6 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:44.014458 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-3d6186fc-5eb8-4f5a-a1eb-df8e8e2c2bcc req-638e27c6-93ee-4d0c-9511-9d8a876e12f6 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:44.023965 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-3d6186fc-5eb8-4f5a-a1eb-df8e8e2c2bcc req-638e27c6-93ee-4d0c-9511-9d8a876e12f6 service nova] Creating event network-changed:83b9862f-0442-4819-8455-b738ec1a0232 for instance 8ddcd684-503e-4123-9078-c4821c63519f on hv-cinder-84984 Sep 15 19:28:44.030298 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-3d6186fc-5eb8-4f5a-a1eb-df8e8e2c2bcc req-638e27c6-93ee-4d0c-9511-9d8a876e12f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066180 Sep 15 19:28:44.032682 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 114/220] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:28:44.189412 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-210a83c4-d345-4158-9f4a-666378768985 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:44.191210 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-210a83c4-d345-4158-9f4a-666378768985 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:44.202285 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-210a83c4-d345-4158-9f4a-666378768985 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:44.203502 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-210a83c4-d345-4158-9f4a-666378768985 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:44.204736 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-210a83c4-d345-4158-9f4a-666378768985 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:44.205889 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-210a83c4-d345-4158-9f4a-666378768985 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:44.206611 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-210a83c4-d345-4158-9f4a-666378768985 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:44.208621 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-210a83c4-d345-4158-9f4a-666378768985 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:44.460784 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-210a83c4-d345-4158-9f4a-666378768985 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:44.478670 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-210a83c4-d345-4158-9f4a-666378768985 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.295742 Sep 15 19:28:44.481972 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 107/221] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:44 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:45.509828 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f1bc614e-e2c8-4424-b0e3-a63ac3236a10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:45.510528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f1bc614e-e2c8-4424-b0e3-a63ac3236a10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:45.517843 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1bc614e-e2c8-4424-b0e3-a63ac3236a10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:45.518583 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1bc614e-e2c8-4424-b0e3-a63ac3236a10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:45.519017 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1bc614e-e2c8-4424-b0e3-a63ac3236a10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:45.519774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1bc614e-e2c8-4424-b0e3-a63ac3236a10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:45.520224 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1bc614e-e2c8-4424-b0e3-a63ac3236a10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:45.520642 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1bc614e-e2c8-4424-b0e3-a63ac3236a10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:45.742361 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f1bc614e-e2c8-4424-b0e3-a63ac3236a10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:45.750135 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f1bc614e-e2c8-4424-b0e3-a63ac3236a10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.245692 Sep 15 19:28:45.750722 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 115/222] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:45 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:46.773893 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bc30b47-702a-4437-84ef-24c25c5921ae tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:46.774587 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5bc30b47-702a-4437-84ef-24c25c5921ae tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:46.781699 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc30b47-702a-4437-84ef-24c25c5921ae tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:46.782281 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc30b47-702a-4437-84ef-24c25c5921ae tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:46.782878 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc30b47-702a-4437-84ef-24c25c5921ae tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:46.783682 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc30b47-702a-4437-84ef-24c25c5921ae tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:46.784409 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc30b47-702a-4437-84ef-24c25c5921ae tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:46.791893 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc30b47-702a-4437-84ef-24c25c5921ae tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:47.070739 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5bc30b47-702a-4437-84ef-24c25c5921ae tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:47.082300 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bc30b47-702a-4437-84ef-24c25c5921ae tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.312210 Sep 15 19:28:47.084546 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 108/223] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:46 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:48.108198 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2fcc519f-507f-4c93-8491-924da83f053e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:48.112502 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2fcc519f-507f-4c93-8491-924da83f053e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:48.127355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fcc519f-507f-4c93-8491-924da83f053e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:48.130161 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fcc519f-507f-4c93-8491-924da83f053e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:48.130798 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fcc519f-507f-4c93-8491-924da83f053e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:48.131583 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fcc519f-507f-4c93-8491-924da83f053e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:48.132116 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fcc519f-507f-4c93-8491-924da83f053e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:48.132550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fcc519f-507f-4c93-8491-924da83f053e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:48.322525 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2fcc519f-507f-4c93-8491-924da83f053e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:48.332094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2fcc519f-507f-4c93-8491-924da83f053e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1502 microversion: 2.1 time: 0.228422 Sep 15 19:28:48.333567 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 116/224] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:48 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:48.367065 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4335b243-c371-4d0c-be86-ec6dab710355 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7756ec4-55a0-4599-a57d-ca3f63b03f9c"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:28:48.371469 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4335b243-c371-4d0c-be86-ec6dab710355 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:48.379848 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4335b243-c371-4d0c-be86-ec6dab710355 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:48.380673 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4335b243-c371-4d0c-be86-ec6dab710355 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:48.381346 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4335b243-c371-4d0c-be86-ec6dab710355 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:48.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4335b243-c371-4d0c-be86-ec6dab710355 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:48.384222 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4335b243-c371-4d0c-be86-ec6dab710355 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:48.386125 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4335b243-c371-4d0c-be86-ec6dab710355 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:48.419912 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-4335b243-c371-4d0c-be86-ec6dab710355 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] HTTP exception thrown: Cannot 'attach_volume' instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 while it is in vm_state rescued Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4335b243-c371-4d0c-be86-ec6dab710355 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Request method failure captured: Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5/os-volume_attachments HTTP/1.1 Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Connection: close Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Length: 74 Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Host: 10.222.0.18 Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjI3x2gP0Gamuz7MW6kt5fLWKd3NLL-PP3YSW0U9aHiJ2uXiR5ltQi77FsMQyXTqL_ThLEIKacMbb8OOMEUFv5IMw0TOPVnWuEE3VOpC98z4LA6wvz2NMPIxQroKGaTQtiVlHx-Xt0EbiHTVWLkl0p0ZJGv_y0Kwm5RmsVyVsM-g7xfCk Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Id: 016f968319fd49d98506030c0bee6021 Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Role: member,reader Sep 15 19:28:48.422726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Roles: member,reader Sep 15 19:28:48.424024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_016f968319fd49d98506030c0bee6021", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/016f968319fd49d98506030c0bee6021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/016f968319fd49d98506030c0bee6021"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/016f968319fd49d98506030c0bee6021"}]}] Sep 15 19:28:48.424024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:28:48.424024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 016f968319fd49d98506030c0bee6021 Sep 15 19:28:48.424024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:28:48.424024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User: tempest-ServerRescueNegativeTestJSON-1036181242-project Sep 15 19:28:48.424024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 15 19:28:48.424024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 15 19:28:48.424024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Id: 1d7c40b5232e46119434aeeb8a6ad4d0 Sep 15 19:28:48.424024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1036181242-project Sep 15 19:28:48.424024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Sep 15 19:28:48.424024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: {"volumeAttachment": {"volumeId": "c7756ec4-55a0-4599-a57d-ca3f63b03f9c"}} Sep 15 19:28:48.424024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: method: > Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: exception: Cannot 'attach_volume' instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 while it is in vm_state rescued Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: action_args: {'server_id': '1b36131f-5f27-419f-b1b2-da2d6ebc60e5', 'body': {'volumeAttachment': {'volumeId': 'c7756ec4-55a0-4599-a57d-ca3f63b03f9c'}}} Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:28:48.424758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 while it is in vm_state rescued Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:28:48.425865 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:28:48.426932 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:28:48.426932 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:28:48.426932 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 while it is in vm_state rescued Sep 15 19:28:48.426932 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:28:48.426932 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4335b243-c371-4d0c-be86-ec6dab710355 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Returning 409 to user: Cannot 'attach_volume' instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 while it is in vm_state rescued {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:28:48.426932 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4335b243-c371-4d0c-be86-ec6dab710355 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "POST /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064979 Sep 15 19:28:48.432086 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 109/225] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:28:48 2022] POST /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5/os-volume_attachments => generated 152 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 15 19:28:48.437649 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-16d1ecd9-7a98-4b9d-b56d-609330a3a1b8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:28:48.442179 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-16d1ecd9-7a98-4b9d-b56d-609330a3a1b8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:48.445496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16d1ecd9-7a98-4b9d-b56d-609330a3a1b8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:48.446531 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16d1ecd9-7a98-4b9d-b56d-609330a3a1b8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:48.447234 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16d1ecd9-7a98-4b9d-b56d-609330a3a1b8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:48.448243 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16d1ecd9-7a98-4b9d-b56d-609330a3a1b8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:48.448924 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16d1ecd9-7a98-4b9d-b56d-609330a3a1b8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:48.449566 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16d1ecd9-7a98-4b9d-b56d-609330a3a1b8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:48.515491 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:48.796908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-16d1ecd9-7a98-4b9d-b56d-609330a3a1b8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "POST /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5/action" status: 202 len: 0 microversion: 2.1 time: 0.363907 Sep 15 19:28:48.797536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 117/226] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:28:48 2022] POST /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:28:48.810669 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0006e030-e4f4-4b41-aa6d-5c95f196047f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:48.812391 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0006e030-e4f4-4b41-aa6d-5c95f196047f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:48.819323 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0006e030-e4f4-4b41-aa6d-5c95f196047f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:48.821229 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0006e030-e4f4-4b41-aa6d-5c95f196047f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:48.821842 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0006e030-e4f4-4b41-aa6d-5c95f196047f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:48.822723 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0006e030-e4f4-4b41-aa6d-5c95f196047f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:48.823332 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0006e030-e4f4-4b41-aa6d-5c95f196047f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:48.824085 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0006e030-e4f4-4b41-aa6d-5c95f196047f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:49.322782 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0006e030-e4f4-4b41-aa6d-5c95f196047f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:49.332112 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0006e030-e4f4-4b41-aa6d-5c95f196047f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1510 microversion: 2.1 time: 0.530017 Sep 15 19:28:49.332723 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 110/227] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:48 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1510 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:49.981566 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6709fdc4-8b0c-4b02-a733-8626586269dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Action: 'create', calling method: .version_select at 0x7f551ec883a0>, body: {"keypair": {"name": "tempest-keypair-1250587690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF6Fx59Wog5okPa1j+kfEC74XbmcLZx/dkF8dAntQj42D/JvrsBhQPBuwmO4rWDdbSk/r0QGk7q0V7EJ72fasaAQe20L4U6/GR1e6BB4DBVWnRK5wjZEGI4uPoJhD/+Rg=="}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:28:50.000506 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=58 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:50.014902 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-6709fdc4-8b0c-4b02-a733-8626586269dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:28:50.021605 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-6709fdc4-8b0c-4b02-a733-8626586269dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for user 0e37c8ca70ad4b6e8430a71d0f5e564f and project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:28:50.194840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6709fdc4-8b0c-4b02-a733-8626586269dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.222908 Sep 15 19:28:50.195493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 118/228] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 15 19:28:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:28:50.357076 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b88c931-06a2-4b44-8d66-22f8bf6abd58 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:50.357703 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b88c931-06a2-4b44-8d66-22f8bf6abd58 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:50.371559 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b88c931-06a2-4b44-8d66-22f8bf6abd58 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:50.371559 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b88c931-06a2-4b44-8d66-22f8bf6abd58 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:50.371559 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b88c931-06a2-4b44-8d66-22f8bf6abd58 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:50.371559 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b88c931-06a2-4b44-8d66-22f8bf6abd58 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:50.372046 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b88c931-06a2-4b44-8d66-22f8bf6abd58 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:50.372046 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b88c931-06a2-4b44-8d66-22f8bf6abd58 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:50.535933 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b88c931-06a2-4b44-8d66-22f8bf6abd58 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:50.544754 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b88c931-06a2-4b44-8d66-22f8bf6abd58 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1510 microversion: 2.1 time: 0.191644 Sep 15 19:28:50.545393 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 111/229] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:50 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:51.573056 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ebc394e8-1656-420c-bad0-6338c45fbb70 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:51.573933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ebc394e8-1656-420c-bad0-6338c45fbb70 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:51.582467 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ebc394e8-1656-420c-bad0-6338c45fbb70 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:51.582954 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ebc394e8-1656-420c-bad0-6338c45fbb70 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:51.583522 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ebc394e8-1656-420c-bad0-6338c45fbb70 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:51.584506 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ebc394e8-1656-420c-bad0-6338c45fbb70 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:51.585290 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ebc394e8-1656-420c-bad0-6338c45fbb70 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:51.585790 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ebc394e8-1656-420c-bad0-6338c45fbb70 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:51.854350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ebc394e8-1656-420c-bad0-6338c45fbb70 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:51.863591 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ebc394e8-1656-420c-bad0-6338c45fbb70 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1510 microversion: 2.1 time: 0.298510 Sep 15 19:28:51.864405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 119/230] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:51 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:28:52.897383 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d4d6eb62-24bb-4aa4-9eb4-ee4d4ffb0f3f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:52.898133 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d4d6eb62-24bb-4aa4-9eb4-ee4d4ffb0f3f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:52.905906 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4d6eb62-24bb-4aa4-9eb4-ee4d4ffb0f3f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:52.906877 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4d6eb62-24bb-4aa4-9eb4-ee4d4ffb0f3f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:52.907534 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4d6eb62-24bb-4aa4-9eb4-ee4d4ffb0f3f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:52.908484 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4d6eb62-24bb-4aa4-9eb4-ee4d4ffb0f3f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:52.909146 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4d6eb62-24bb-4aa4-9eb4-ee4d4ffb0f3f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:52.910091 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4d6eb62-24bb-4aa4-9eb4-ee4d4ffb0f3f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:53.173590 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d4d6eb62-24bb-4aa4-9eb4-ee4d4ffb0f3f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:53.190361 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d4d6eb62-24bb-4aa4-9eb4-ee4d4ffb0f3f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1510 microversion: 2.1 time: 0.296947 Sep 15 19:28:53.191723 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 112/231] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:52 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:53.399750 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-550874794", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "networks": [{"uuid": "1c551f32-2b72-43e2-b898-66bfeafd2424"}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:28:53.456054 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] validate_networks() for [('1c551f32-2b72-43e2-b898-66bfeafd2424', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:28:54.089859 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1442542922", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f608162d-6498-4eba-ac51-7e7b4de51e0d"}], "security_groups": [{"name": "tempest-securitygroup--2042218780"}], "key_name": "tempest-keypair-1250587690", "user_data": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:28:54.251167 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] validate_networks() for [('f608162d-6498-4eba-ac51-7e7b4de51e0d', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:28:54.429414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:28:54.430416 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:28:54.431288 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:28:54.433744 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:28:54.434819 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:28:54.464490 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:54.465761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:54.466759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:54.468799 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:54.470335 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:54.472964 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:54.501824 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Getting quotas for project cf90b9345ae84e26b58e9238da0dac2e. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:28:54.512905 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Getting quotas for user 7de2f8a8c6644220b9e1ed37a48b7d9a and project cf90b9345ae84e26b58e9238da0dac2e. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:28:54.534614 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:28:54.546714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:28:54.723991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-98965a85-d152-4b8e-95b8-4db2b35b7661 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338329 Sep 15 19:28:54.726325 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 120/232] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:28:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 19:28:54.738801 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-28ad75c5-4518-49aa-8bb6-4c8a82733728 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:54.739768 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-28ad75c5-4518-49aa-8bb6-4c8a82733728 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:54.770586 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28ad75c5-4518-49aa-8bb6-4c8a82733728 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:54.787479 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28ad75c5-4518-49aa-8bb6-4c8a82733728 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:54.789104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28ad75c5-4518-49aa-8bb6-4c8a82733728 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:54.791908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28ad75c5-4518-49aa-8bb6-4c8a82733728 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:54.792788 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28ad75c5-4518-49aa-8bb6-4c8a82733728 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:54.795519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28ad75c5-4518-49aa-8bb6-4c8a82733728 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:54.995774 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:28:54.996213 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:28:54.996692 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:28:54.997117 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:28:54.997525 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:28:55.014076 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:55.014512 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:55.014958 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:55.015727 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:55.021837 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:55.021837 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:55.073379 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:28:55.079888 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for user 0e37c8ca70ad4b6e8430a71d0f5e564f and project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:28:55.095470 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:28:55.099106 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:28:55.293908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-28ad75c5-4518-49aa-8bb6-4c8a82733728 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:55.310142 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e1d3893c-acf6-4686-a46d-b98a80d9b2c7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.227230 Sep 15 19:28:55.310711 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-28ad75c5-4518-49aa-8bb6-4c8a82733728 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1510 microversion: 2.1 time: 0.582951 Sep 15 19:28:55.319207 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 113/233] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:28:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 19:28:55.328245 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 121/234] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:54 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1510 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:55.328463 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5c3c6449-e950-4134-bfec-d0041f7fecd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:55.328463 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5c3c6449-e950-4134-bfec-d0041f7fecd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:55.328615 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2f9cc347-caf4-4276-a134-adbc0fe7c890 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:55.328615 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2f9cc347-caf4-4276-a134-adbc0fe7c890 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:55.480831 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2f9cc347-caf4-4276-a134-adbc0fe7c890 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:55.488986 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2f9cc347-caf4-4276-a134-adbc0fe7c890 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1242 microversion: 2.1 time: 0.169590 Sep 15 19:28:55.489662 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 122/235] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:55 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1242 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:55.500051 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5c3c6449-e950-4134-bfec-d0041f7fecd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:55.526683 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5c3c6449-e950-4134-bfec-d0041f7fecd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1213 microversion: 2.1 time: 0.213552 Sep 15 19:28:55.544514 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 114/236] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:55 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1213 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:56.346827 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0f9c3eb3-128e-4cde-ba7e-2ca9fdbd4902 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:56.347719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0f9c3eb3-128e-4cde-ba7e-2ca9fdbd4902 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:56.356093 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0f9c3eb3-128e-4cde-ba7e-2ca9fdbd4902 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:56.356754 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0f9c3eb3-128e-4cde-ba7e-2ca9fdbd4902 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:56.357202 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0f9c3eb3-128e-4cde-ba7e-2ca9fdbd4902 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:56.357908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0f9c3eb3-128e-4cde-ba7e-2ca9fdbd4902 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:56.358355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0f9c3eb3-128e-4cde-ba7e-2ca9fdbd4902 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:56.358772 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0f9c3eb3-128e-4cde-ba7e-2ca9fdbd4902 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:56.516430 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f22e8a1-883c-4351-b867-3d1b6737e43a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:56.517378 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f22e8a1-883c-4351-b867-3d1b6737e43a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:56.600425 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0f9c3eb3-128e-4cde-ba7e-2ca9fdbd4902 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:56.615218 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0f9c3eb3-128e-4cde-ba7e-2ca9fdbd4902 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1516 microversion: 2.1 time: 0.272520 Sep 15 19:28:56.615951 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 123/237] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:56 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1516 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:56.630066 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3f22e8a1-883c-4351-b867-3d1b6737e43a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:56.630305 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-838df647-2219-4d73-90a5-40b0a90649e9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:56.630305 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-838df647-2219-4d73-90a5-40b0a90649e9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:56.635074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-838df647-2219-4d73-90a5-40b0a90649e9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:56.635689 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f22e8a1-883c-4351-b867-3d1b6737e43a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1242 microversion: 2.1 time: 0.126347 Sep 15 19:28:56.635895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-838df647-2219-4d73-90a5-40b0a90649e9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:56.636371 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-838df647-2219-4d73-90a5-40b0a90649e9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:56.637136 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 115/238] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:56 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1242 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:56.637325 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-838df647-2219-4d73-90a5-40b0a90649e9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:56.637602 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-838df647-2219-4d73-90a5-40b0a90649e9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:56.638496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-838df647-2219-4d73-90a5-40b0a90649e9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:56.719991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-838df647-2219-4d73-90a5-40b0a90649e9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:56.730512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-838df647-2219-4d73-90a5-40b0a90649e9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1217 microversion: 2.1 time: 0.113234 Sep 15 19:28:56.731400 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 124/239] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:56 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:57.666405 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6a3291f4-0c6e-4c15-b493-22f8a25a60dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:57.667949 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6a3291f4-0c6e-4c15-b493-22f8a25a60dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:57.671395 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:57.693040 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a3291f4-0c6e-4c15-b493-22f8a25a60dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:57.716359 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a3291f4-0c6e-4c15-b493-22f8a25a60dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:57.716359 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a3291f4-0c6e-4c15-b493-22f8a25a60dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:57.716974 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a3291f4-0c6e-4c15-b493-22f8a25a60dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:57.719441 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a3291f4-0c6e-4c15-b493-22f8a25a60dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:57.720060 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a3291f4-0c6e-4c15-b493-22f8a25a60dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:57.757790 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ab0c5117-21ac-4ed0-9809-680c258a9dba tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:57.758582 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ab0c5117-21ac-4ed0-9809-680c258a9dba tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:57.776414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab0c5117-21ac-4ed0-9809-680c258a9dba tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:57.777323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab0c5117-21ac-4ed0-9809-680c258a9dba tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:57.780981 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab0c5117-21ac-4ed0-9809-680c258a9dba tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:57.782845 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab0c5117-21ac-4ed0-9809-680c258a9dba tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:57.783558 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab0c5117-21ac-4ed0-9809-680c258a9dba tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:57.785482 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab0c5117-21ac-4ed0-9809-680c258a9dba tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:57.909261 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6a3291f4-0c6e-4c15-b493-22f8a25a60dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:57.923227 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6a3291f4-0c6e-4c15-b493-22f8a25a60dd tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1246 microversion: 2.1 time: 0.261863 Sep 15 19:28:57.924831 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 116/240] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:57 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1246 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:57.970024 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ab0c5117-21ac-4ed0-9809-680c258a9dba tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:57.981620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ab0c5117-21ac-4ed0-9809-680c258a9dba tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1217 microversion: 2.1 time: 0.229107 Sep 15 19:28:57.982211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 125/241] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:57 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:58.960802 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ca9a9f29-2469-48f8-b382-d2c1b0440df0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:58.961659 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ca9a9f29-2469-48f8-b382-d2c1b0440df0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:59.000869 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca9a9f29-2469-48f8-b382-d2c1b0440df0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:59.001508 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca9a9f29-2469-48f8-b382-d2c1b0440df0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:59.006451 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca9a9f29-2469-48f8-b382-d2c1b0440df0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:59.008311 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca9a9f29-2469-48f8-b382-d2c1b0440df0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:59.009011 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca9a9f29-2469-48f8-b382-d2c1b0440df0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:59.009666 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca9a9f29-2469-48f8-b382-d2c1b0440df0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:59.015602 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-aff0a071-f241-45c4-b84a-e64113758fd9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:28:59.016579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-aff0a071-f241-45c4-b84a-e64113758fd9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:28:59.051892 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:59.052890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aff0a071-f241-45c4-b84a-e64113758fd9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:59.053649 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aff0a071-f241-45c4-b84a-e64113758fd9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:59.054840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aff0a071-f241-45c4-b84a-e64113758fd9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:59.056791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aff0a071-f241-45c4-b84a-e64113758fd9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:28:59.058018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aff0a071-f241-45c4-b84a-e64113758fd9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:28:59.058843 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aff0a071-f241-45c4-b84a-e64113758fd9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:28:59.105723 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ca9a9f29-2469-48f8-b382-d2c1b0440df0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:59.117365 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ca9a9f29-2469-48f8-b382-d2c1b0440df0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1246 microversion: 2.1 time: 0.169158 Sep 15 19:28:59.118473 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 117/242] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:58 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1246 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:28:59.161611 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-aff0a071-f241-45c4-b84a-e64113758fd9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:28:59.171536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-aff0a071-f241-45c4-b84a-e64113758fd9 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1217 microversion: 2.1 time: 0.164944 Sep 15 19:28:59.173586 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 126/243] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:28:59 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:00.401383 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7865ac7-b77d-4cfb-8389-dc21c156d733 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:00.401383 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7865ac7-b77d-4cfb-8389-dc21c156d733 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:00.401383 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7865ac7-b77d-4cfb-8389-dc21c156d733 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:00.401383 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7865ac7-b77d-4cfb-8389-dc21c156d733 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:00.403186 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7865ac7-b77d-4cfb-8389-dc21c156d733 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:00.403186 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7865ac7-b77d-4cfb-8389-dc21c156d733 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:00.403186 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7865ac7-b77d-4cfb-8389-dc21c156d733 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:00.403186 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7865ac7-b77d-4cfb-8389-dc21c156d733 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:00.405124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0dce77ed-e6ef-495e-ba37-c3f4c098d306 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:00.405124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0dce77ed-e6ef-495e-ba37-c3f4c098d306 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:00.405124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0dce77ed-e6ef-495e-ba37-c3f4c098d306 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:00.405124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0dce77ed-e6ef-495e-ba37-c3f4c098d306 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:00.407287 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0dce77ed-e6ef-495e-ba37-c3f4c098d306 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:00.407287 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0dce77ed-e6ef-495e-ba37-c3f4c098d306 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:00.407287 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0dce77ed-e6ef-495e-ba37-c3f4c098d306 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:00.407287 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0dce77ed-e6ef-495e-ba37-c3f4c098d306 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:00.409351 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e7865ac7-b77d-4cfb-8389-dc21c156d733 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:00.409351 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7865ac7-b77d-4cfb-8389-dc21c156d733 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1238 microversion: 2.1 time: 0.194208 Sep 15 19:29:00.409351 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 118/244] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:00 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1238 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:00.519759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0dce77ed-e6ef-495e-ba37-c3f4c098d306 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:00.535257 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0dce77ed-e6ef-495e-ba37-c3f4c098d306 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1265 microversion: 2.1 time: 0.332848 Sep 15 19:29:00.551543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 127/245] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:00 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1265 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:01.476701 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af943ba3-c46a-4cc8-afdd-9da6e6a5c459 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:01.477476 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af943ba3-c46a-4cc8-afdd-9da6e6a5c459 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:01.489827 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af943ba3-c46a-4cc8-afdd-9da6e6a5c459 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:01.491513 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af943ba3-c46a-4cc8-afdd-9da6e6a5c459 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:01.492767 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af943ba3-c46a-4cc8-afdd-9da6e6a5c459 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:01.494325 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af943ba3-c46a-4cc8-afdd-9da6e6a5c459 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:01.496582 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af943ba3-c46a-4cc8-afdd-9da6e6a5c459 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:01.497279 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af943ba3-c46a-4cc8-afdd-9da6e6a5c459 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:01.589550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2132554f-7189-49f6-a7c4-6b819a68216e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:01.591213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2132554f-7189-49f6-a7c4-6b819a68216e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:01.601568 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2132554f-7189-49f6-a7c4-6b819a68216e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:01.602075 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2132554f-7189-49f6-a7c4-6b819a68216e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:01.603195 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2132554f-7189-49f6-a7c4-6b819a68216e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:01.604298 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2132554f-7189-49f6-a7c4-6b819a68216e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:01.604998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2132554f-7189-49f6-a7c4-6b819a68216e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:01.605676 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2132554f-7189-49f6-a7c4-6b819a68216e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:01.659346 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-af943ba3-c46a-4cc8-afdd-9da6e6a5c459 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:01.673050 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af943ba3-c46a-4cc8-afdd-9da6e6a5c459 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1294 microversion: 2.1 time: 0.200274 Sep 15 19:29:01.674507 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 119/246] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:01 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1294 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:01.875785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2132554f-7189-49f6-a7c4-6b819a68216e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:01.885980 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2132554f-7189-49f6-a7c4-6b819a68216e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1273 microversion: 2.1 time: 0.301422 Sep 15 19:29:01.886868 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 128/247] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:01 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1273 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:01.995461 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1c79599f-c350-4999-88f1-a0df2ad6ede5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Action: 'create', calling method: .version_select at 0x7f551ffedee0>, body: {"keypair": {"name": "tempest-keypair-439571901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQPT6GoL22kvHNzJ43DiNM5/kqgXP3LSSBIcqgVhtrlyfD0k3UfLl0A1zeHCGwc3TRuzeYeol9mLYYZwYIdPozltQqkqZgxHw+qj41fzvTcVqOPKhAAg3KCoug0wiUi+w=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:02.022666 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-1c79599f-c350-4999-88f1-a0df2ad6ede5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Getting quotas for project 016f968319fd49d98506030c0bee6021. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:29:02.028918 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-1c79599f-c350-4999-88f1-a0df2ad6ede5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Getting quotas for user 1d7c40b5232e46119434aeeb8a6ad4d0 and project 016f968319fd49d98506030c0bee6021. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:29:02.186266 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1c79599f-c350-4999-88f1-a0df2ad6ede5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.196417 Sep 15 19:29:02.193428 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 120/248] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 15 19:29:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:02.700319 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a8e283ae-27a0-4c51-8f21-838646e203d1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:02.700925 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a8e283ae-27a0-4c51-8f21-838646e203d1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:02.707322 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8e283ae-27a0-4c51-8f21-838646e203d1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:02.707904 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8e283ae-27a0-4c51-8f21-838646e203d1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:02.708361 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8e283ae-27a0-4c51-8f21-838646e203d1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:02.709051 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8e283ae-27a0-4c51-8f21-838646e203d1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:02.709666 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8e283ae-27a0-4c51-8f21-838646e203d1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:02.710485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8e283ae-27a0-4c51-8f21-838646e203d1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:02.787812 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a8e283ae-27a0-4c51-8f21-838646e203d1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:02.796089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a8e283ae-27a0-4c51-8f21-838646e203d1 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1302 microversion: 2.1 time: 0.099528 Sep 15 19:29:02.796667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 129/249] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:02 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1302 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:02.912815 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-878200f5-25af-4629-b11e-cef55598f09d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:02.914290 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-878200f5-25af-4629-b11e-cef55598f09d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:02.938422 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-878200f5-25af-4629-b11e-cef55598f09d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:02.939779 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-878200f5-25af-4629-b11e-cef55598f09d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:02.946563 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-878200f5-25af-4629-b11e-cef55598f09d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:02.946563 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-878200f5-25af-4629-b11e-cef55598f09d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:02.946563 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-878200f5-25af-4629-b11e-cef55598f09d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:02.946563 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-878200f5-25af-4629-b11e-cef55598f09d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:03.169375 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-878200f5-25af-4629-b11e-cef55598f09d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:03.180352 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-878200f5-25af-4629-b11e-cef55598f09d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.273729 Sep 15 19:29:03.198392 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 121/250] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:02 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:03.829492 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3977e31c-a524-4b6e-af02-708bea89d8d7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:03.830665 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3977e31c-a524-4b6e-af02-708bea89d8d7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:03.849664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3977e31c-a524-4b6e-af02-708bea89d8d7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:03.850538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3977e31c-a524-4b6e-af02-708bea89d8d7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:03.851784 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3977e31c-a524-4b6e-af02-708bea89d8d7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:03.852708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3977e31c-a524-4b6e-af02-708bea89d8d7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:03.853352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3977e31c-a524-4b6e-af02-708bea89d8d7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:03.853968 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3977e31c-a524-4b6e-af02-708bea89d8d7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:04.010398 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3977e31c-a524-4b6e-af02-708bea89d8d7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:04.022182 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3977e31c-a524-4b6e-af02-708bea89d8d7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1300 microversion: 2.1 time: 0.201657 Sep 15 19:29:04.041134 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 130/251] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:03 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1300 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:04.211508 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e0a678f2-e079-4359-b31f-b4541cfc426a tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:04.213218 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e0a678f2-e079-4359-b31f-b4541cfc426a tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:04.235751 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0a678f2-e079-4359-b31f-b4541cfc426a tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:04.236989 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0a678f2-e079-4359-b31f-b4541cfc426a tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:04.237732 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0a678f2-e079-4359-b31f-b4541cfc426a tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:04.238660 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0a678f2-e079-4359-b31f-b4541cfc426a tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:04.239353 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0a678f2-e079-4359-b31f-b4541cfc426a tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:04.239981 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0a678f2-e079-4359-b31f-b4541cfc426a tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:04.583482 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e0a678f2-e079-4359-b31f-b4541cfc426a tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:04.599946 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e0a678f2-e079-4359-b31f-b4541cfc426a tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.392976 Sep 15 19:29:04.601596 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 122/252] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:04 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:05.059120 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9d7fb336-607e-4de2-b9a4-fec2e6d1018b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:05.061331 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9d7fb336-607e-4de2-b9a4-fec2e6d1018b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:05.070402 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:05.072620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d7fb336-607e-4de2-b9a4-fec2e6d1018b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:05.073159 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d7fb336-607e-4de2-b9a4-fec2e6d1018b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:05.073599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d7fb336-607e-4de2-b9a4-fec2e6d1018b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:05.074309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d7fb336-607e-4de2-b9a4-fec2e6d1018b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:05.075000 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d7fb336-607e-4de2-b9a4-fec2e6d1018b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:05.075734 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d7fb336-607e-4de2-b9a4-fec2e6d1018b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:05.483555 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=12 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:05.630579 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed7469e3-2168-451d-a45b-017802debd6d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:05.631227 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed7469e3-2168-451d-a45b-017802debd6d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:05.640668 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:05.643247 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed7469e3-2168-451d-a45b-017802debd6d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:05.652110 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed7469e3-2168-451d-a45b-017802debd6d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:05.653011 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed7469e3-2168-451d-a45b-017802debd6d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:05.667386 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed7469e3-2168-451d-a45b-017802debd6d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:05.668150 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed7469e3-2168-451d-a45b-017802debd6d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:05.668556 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9d7fb336-607e-4de2-b9a4-fec2e6d1018b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:05.668728 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed7469e3-2168-451d-a45b-017802debd6d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:05.688592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9d7fb336-607e-4de2-b9a4-fec2e6d1018b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.637867 Sep 15 19:29:05.718176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 131/253] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:05 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:06.039604 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-cdf90a3c-40a7-4660-803b-b807271aa102 req-f55d268c-24c6-4334-845e-902f0c74f470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4836cd00-5dd6-454d-84d6-643e1c0843c2", "tag": "6a575adf-3c82-4218-b116-aeb619bfddcc"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:06.059718 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed7469e3-2168-451d-a45b-017802debd6d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:06.066583 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-cdf90a3c-40a7-4660-803b-b807271aa102 req-f55d268c-24c6-4334-845e-902f0c74f470 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:06.068336 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-cdf90a3c-40a7-4660-803b-b807271aa102 req-f55d268c-24c6-4334-845e-902f0c74f470 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:06.068336 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-cdf90a3c-40a7-4660-803b-b807271aa102 req-f55d268c-24c6-4334-845e-902f0c74f470 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:06.078160 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed7469e3-2168-451d-a45b-017802debd6d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.451431 Sep 15 19:29:06.081234 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 123/254] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:05 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:06.106396 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-cdf90a3c-40a7-4660-803b-b807271aa102 req-f55d268c-24c6-4334-845e-902f0c74f470 service nova] Creating event network-changed:6a575adf-3c82-4218-b116-aeb619bfddcc for instance 4836cd00-5dd6-454d-84d6-643e1c0843c2 on hv-cinder-84984 Sep 15 19:29:06.117560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-cdf90a3c-40a7-4660-803b-b807271aa102 req-f55d268c-24c6-4334-845e-902f0c74f470 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084957 Sep 15 19:29:06.119000 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 132/255] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:06.726038 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-927dbe23-1ef2-4565-bc25-4840dc5451f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:06.728491 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-927dbe23-1ef2-4565-bc25-4840dc5451f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:06.757177 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927dbe23-1ef2-4565-bc25-4840dc5451f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:06.757688 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927dbe23-1ef2-4565-bc25-4840dc5451f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:06.758134 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927dbe23-1ef2-4565-bc25-4840dc5451f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:06.758860 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927dbe23-1ef2-4565-bc25-4840dc5451f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:06.759317 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927dbe23-1ef2-4565-bc25-4840dc5451f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:06.759773 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927dbe23-1ef2-4565-bc25-4840dc5451f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:07.107264 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5b0151cb-1d26-4223-bc7c-f33d58137b89 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:07.108819 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5b0151cb-1d26-4223-bc7c-f33d58137b89 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:07.124767 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b0151cb-1d26-4223-bc7c-f33d58137b89 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:07.125655 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b0151cb-1d26-4223-bc7c-f33d58137b89 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:07.129619 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b0151cb-1d26-4223-bc7c-f33d58137b89 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:07.130741 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b0151cb-1d26-4223-bc7c-f33d58137b89 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:07.131453 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b0151cb-1d26-4223-bc7c-f33d58137b89 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:07.132934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b0151cb-1d26-4223-bc7c-f33d58137b89 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:07.328438 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-927dbe23-1ef2-4565-bc25-4840dc5451f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:07.367604 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-927dbe23-1ef2-4565-bc25-4840dc5451f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.646853 Sep 15 19:29:07.368544 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 124/256] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:06 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:07.599992 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5b0151cb-1d26-4223-bc7c-f33d58137b89 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:07.610385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5b0151cb-1d26-4223-bc7c-f33d58137b89 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.508490 Sep 15 19:29:07.611075 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 133/257] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:07 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:08.154351 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-77fb3e93-3c45-4d9e-a923-274438299bd2 req-4a503627-a711-4ca8-a492-98b788548861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6cfa71-df2d-4e56-ba89-35f6153f327f", "tag": "f848c54c-bc13-4277-851b-f4482d166911"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:08.166462 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-77fb3e93-3c45-4d9e-a923-274438299bd2 req-4a503627-a711-4ca8-a492-98b788548861 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:08.167280 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-77fb3e93-3c45-4d9e-a923-274438299bd2 req-4a503627-a711-4ca8-a492-98b788548861 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:08.168145 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-77fb3e93-3c45-4d9e-a923-274438299bd2 req-4a503627-a711-4ca8-a492-98b788548861 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:08.180531 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-77fb3e93-3c45-4d9e-a923-274438299bd2 req-4a503627-a711-4ca8-a492-98b788548861 service nova] Creating event network-changed:f848c54c-bc13-4277-851b-f4482d166911 for instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f on hv-cinder-84984 Sep 15 19:29:08.185861 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-77fb3e93-3c45-4d9e-a923-274438299bd2 req-4a503627-a711-4ca8-a492-98b788548861 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036460 Sep 15 19:29:08.191093 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 125/258] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:08.401854 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f93d5ff9-9d92-432c-a570-c4bfc9a08076 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:08.403966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f93d5ff9-9d92-432c-a570-c4bfc9a08076 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:08.422068 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f93d5ff9-9d92-432c-a570-c4bfc9a08076 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:08.425595 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f93d5ff9-9d92-432c-a570-c4bfc9a08076 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:08.426793 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f93d5ff9-9d92-432c-a570-c4bfc9a08076 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:08.433543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f93d5ff9-9d92-432c-a570-c4bfc9a08076 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:08.434559 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f93d5ff9-9d92-432c-a570-c4bfc9a08076 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:08.435180 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f93d5ff9-9d92-432c-a570-c4bfc9a08076 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:08.441912 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-824181869", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2ffb04b-7869-41f6-aad2-f6912ace930a"}], "security_groups": [{"name": "tempest-securitygroup--1319715227"}], "key_name": "tempest-keypair-439571901", "user_data": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:08.668754 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] validate_networks() for [('f2ffb04b-7869-41f6-aad2-f6912ace930a', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:29:08.718268 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f93d5ff9-9d92-432c-a570-c4bfc9a08076 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:08.736159 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f93d5ff9-9d92-432c-a570-c4bfc9a08076 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.341731 Sep 15 19:29:08.749630 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 134/259] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:08 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:08.765769 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-51f7ef75-4910-4331-af76-cc1b1abd706d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:08.769460 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-51f7ef75-4910-4331-af76-cc1b1abd706d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:08.778041 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-51f7ef75-4910-4331-af76-cc1b1abd706d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:08.780135 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-51f7ef75-4910-4331-af76-cc1b1abd706d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:08.780789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-51f7ef75-4910-4331-af76-cc1b1abd706d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:08.782431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-51f7ef75-4910-4331-af76-cc1b1abd706d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:08.783284 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-51f7ef75-4910-4331-af76-cc1b1abd706d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:08.783908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-51f7ef75-4910-4331-af76-cc1b1abd706d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:08.970406 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-51f7ef75-4910-4331-af76-cc1b1abd706d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:08.981364 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-51f7ef75-4910-4331-af76-cc1b1abd706d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.230148 Sep 15 19:29:08.996351 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 135/260] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:08 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:09.180063 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:29:09.181102 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:29:09.182838 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:29:09.183392 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:29:09.184174 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:29:09.194983 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:09.195466 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:09.196125 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:09.196856 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:09.197599 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:09.198028 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:09.217578 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Getting quotas for project 016f968319fd49d98506030c0bee6021. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:29:09.226913 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Getting quotas for user 1d7c40b5232e46119434aeeb8a6ad4d0 and project 016f968319fd49d98506030c0bee6021. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:29:09.239850 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:29:09.245250 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:29:09.373438 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2617f6cb-141c-4b62-af0a-c5cc9ddebfca tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.940076 Sep 15 19:29:09.374678 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 126/261] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:29:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 19:29:09.386059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6bc1b404-3a26-4ff6-a4c5-90b8621476a4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:09.387124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6bc1b404-3a26-4ff6-a4c5-90b8621476a4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:09.457776 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6bc1b404-3a26-4ff6-a4c5-90b8621476a4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:09.482708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6bc1b404-3a26-4ff6-a4c5-90b8621476a4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1244 microversion: 2.1 time: 0.100313 Sep 15 19:29:09.488442 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 136/262] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:09 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:09.770471 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dfb6d445-88ab-401b-8453-72b3c4690043 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:09.771989 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dfb6d445-88ab-401b-8453-72b3c4690043 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:09.784803 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb6d445-88ab-401b-8453-72b3c4690043 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:09.785837 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb6d445-88ab-401b-8453-72b3c4690043 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:09.787374 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb6d445-88ab-401b-8453-72b3c4690043 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:09.788187 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb6d445-88ab-401b-8453-72b3c4690043 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:09.788748 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb6d445-88ab-401b-8453-72b3c4690043 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:09.789285 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb6d445-88ab-401b-8453-72b3c4690043 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:09.972141 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-dfb6d445-88ab-401b-8453-72b3c4690043 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:09.982348 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dfb6d445-88ab-401b-8453-72b3c4690043 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.215547 Sep 15 19:29:09.982939 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 127/263] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:09 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:10.006596 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bf825601-f644-478c-a58e-45984c2779f6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:10.010119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bf825601-f644-478c-a58e-45984c2779f6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:10.016097 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf825601-f644-478c-a58e-45984c2779f6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:10.016519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf825601-f644-478c-a58e-45984c2779f6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:10.017041 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf825601-f644-478c-a58e-45984c2779f6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:10.017761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf825601-f644-478c-a58e-45984c2779f6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:10.018211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf825601-f644-478c-a58e-45984c2779f6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:10.018633 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf825601-f644-478c-a58e-45984c2779f6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:10.320680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bf825601-f644-478c-a58e-45984c2779f6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:10.352229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bf825601-f644-478c-a58e-45984c2779f6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.335308 Sep 15 19:29:10.355158 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 137/264] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:10 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:10.516095 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a95c59f-296b-4859-b79b-0ec8a8cfb3bd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:10.517547 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3a95c59f-296b-4859-b79b-0ec8a8cfb3bd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:10.525483 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a95c59f-296b-4859-b79b-0ec8a8cfb3bd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:10.526246 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a95c59f-296b-4859-b79b-0ec8a8cfb3bd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:10.526843 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a95c59f-296b-4859-b79b-0ec8a8cfb3bd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:10.528077 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a95c59f-296b-4859-b79b-0ec8a8cfb3bd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:10.528678 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a95c59f-296b-4859-b79b-0ec8a8cfb3bd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:10.529250 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a95c59f-296b-4859-b79b-0ec8a8cfb3bd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:10.620269 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3a95c59f-296b-4859-b79b-0ec8a8cfb3bd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:10.629979 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3a95c59f-296b-4859-b79b-0ec8a8cfb3bd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1248 microversion: 2.1 time: 0.119486 Sep 15 19:29:10.633634 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 128/265] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:10 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1248 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:11.006157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f1f1a960-8a30-4ca7-ad6e-90eccad835e9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:11.008628 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f1f1a960-8a30-4ca7-ad6e-90eccad835e9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:11.016143 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1f1a960-8a30-4ca7-ad6e-90eccad835e9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:11.016938 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1f1a960-8a30-4ca7-ad6e-90eccad835e9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:11.017490 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1f1a960-8a30-4ca7-ad6e-90eccad835e9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:11.018498 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1f1a960-8a30-4ca7-ad6e-90eccad835e9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:11.019481 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1f1a960-8a30-4ca7-ad6e-90eccad835e9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:11.020066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1f1a960-8a30-4ca7-ad6e-90eccad835e9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:11.056993 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:11.195232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f1f1a960-8a30-4ca7-ad6e-90eccad835e9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:11.207569 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f1f1a960-8a30-4ca7-ad6e-90eccad835e9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.201814 Sep 15 19:29:11.207569 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 138/266] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:11 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:11.378885 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-688ef029-05d3-42f0-9b06-3f7ba2be3a08 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:11.379403 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-688ef029-05d3-42f0-9b06-3f7ba2be3a08 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:11.386864 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-688ef029-05d3-42f0-9b06-3f7ba2be3a08 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:11.387344 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-688ef029-05d3-42f0-9b06-3f7ba2be3a08 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:11.387814 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-688ef029-05d3-42f0-9b06-3f7ba2be3a08 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:11.388534 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-688ef029-05d3-42f0-9b06-3f7ba2be3a08 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:11.388982 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-688ef029-05d3-42f0-9b06-3f7ba2be3a08 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:11.389399 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-688ef029-05d3-42f0-9b06-3f7ba2be3a08 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:11.537151 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-688ef029-05d3-42f0-9b06-3f7ba2be3a08 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:11.546404 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-688ef029-05d3-42f0-9b06-3f7ba2be3a08 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.171457 Sep 15 19:29:11.546965 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 129/267] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:11 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:11.654550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-766d36a5-532c-487f-801c-907ad0fe3485 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:11.655051 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-766d36a5-532c-487f-801c-907ad0fe3485 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:11.661230 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-766d36a5-532c-487f-801c-907ad0fe3485 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:11.661714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-766d36a5-532c-487f-801c-907ad0fe3485 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:11.662153 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-766d36a5-532c-487f-801c-907ad0fe3485 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:11.662847 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-766d36a5-532c-487f-801c-907ad0fe3485 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:11.663304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-766d36a5-532c-487f-801c-907ad0fe3485 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:11.663749 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-766d36a5-532c-487f-801c-907ad0fe3485 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:11.732968 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-766d36a5-532c-487f-801c-907ad0fe3485 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:11.740357 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-766d36a5-532c-487f-801c-907ad0fe3485 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1248 microversion: 2.1 time: 0.089735 Sep 15 19:29:11.740975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 139/268] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:11 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:12.228490 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bfcc8344-5c8a-4ce7-95f8-93bbf6159f7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:12.229101 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bfcc8344-5c8a-4ce7-95f8-93bbf6159f7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:12.235192 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfcc8344-5c8a-4ce7-95f8-93bbf6159f7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:12.235692 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfcc8344-5c8a-4ce7-95f8-93bbf6159f7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:12.236135 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfcc8344-5c8a-4ce7-95f8-93bbf6159f7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:12.236824 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfcc8344-5c8a-4ce7-95f8-93bbf6159f7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:12.237335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfcc8344-5c8a-4ce7-95f8-93bbf6159f7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:12.237756 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfcc8344-5c8a-4ce7-95f8-93bbf6159f7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:12.383090 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bfcc8344-5c8a-4ce7-95f8-93bbf6159f7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:12.391461 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bfcc8344-5c8a-4ce7-95f8-93bbf6159f7d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.166833 Sep 15 19:29:12.392052 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 130/269] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:12 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:12.570407 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e8003f92-d22d-4d94-b3d5-34dbc3e99d65 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:12.571046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e8003f92-d22d-4d94-b3d5-34dbc3e99d65 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:12.578216 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8003f92-d22d-4d94-b3d5-34dbc3e99d65 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:12.578692 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8003f92-d22d-4d94-b3d5-34dbc3e99d65 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:12.579128 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8003f92-d22d-4d94-b3d5-34dbc3e99d65 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:12.579847 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8003f92-d22d-4d94-b3d5-34dbc3e99d65 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:12.580294 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8003f92-d22d-4d94-b3d5-34dbc3e99d65 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:12.580709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8003f92-d22d-4d94-b3d5-34dbc3e99d65 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:12.715596 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e8003f92-d22d-4d94-b3d5-34dbc3e99d65 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:12.723508 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e8003f92-d22d-4d94-b3d5-34dbc3e99d65 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.157030 Sep 15 19:29:12.724508 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 140/270] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:12 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:12.764891 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-676d8113-2faa-45e5-a675-43278506bdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:12.765654 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-676d8113-2faa-45e5-a675-43278506bdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:12.771690 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-676d8113-2faa-45e5-a675-43278506bdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:12.772165 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-676d8113-2faa-45e5-a675-43278506bdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:12.772610 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-676d8113-2faa-45e5-a675-43278506bdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:12.773316 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-676d8113-2faa-45e5-a675-43278506bdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:12.773770 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-676d8113-2faa-45e5-a675-43278506bdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:12.774197 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-676d8113-2faa-45e5-a675-43278506bdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:12.839880 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-676d8113-2faa-45e5-a675-43278506bdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:12.847866 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-676d8113-2faa-45e5-a675-43278506bdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1248 microversion: 2.1 time: 0.086786 Sep 15 19:29:12.848448 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 131/271] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:12 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1248 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:12.900620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ee080892-1f7c-4852-bdd7-9b1305b1fdc5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Action: 'create', calling method: .version_select at 0x7f551ee80b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-157560746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8BVsr6Jw93p5JKcX0pn//N8Lf/2IBtDmuqTEPv4Iea/ALnbmNBHDsalwcSMNDLwWgprT/MwvGzNj2YHhNE3vE+M+ZUIncuVfr0Uqjx5bYAh/98MrUcLWf7npNQ2bbCCg=="}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:12.917588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-ee080892-1f7c-4852-bdd7-9b1305b1fdc5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Getting quotas for project 4fd3f2da26af4d3db4c6db4ceb851558. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:29:12.921486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-ee080892-1f7c-4852-bdd7-9b1305b1fdc5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Getting quotas for user fd8d3fe4be354995b1698b9783ce6c65 and project 4fd3f2da26af4d3db4c6db4ceb851558. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:29:13.033105 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ee080892-1f7c-4852-bdd7-9b1305b1fdc5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.136853 Sep 15 19:29:13.033663 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 141/272] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 15 19:29:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:13.140954 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-831156609", "imageRef": "51f1c951-5346-46bb-9d9b-745fd411b36c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-157560746", "networks": [{"uuid": "c851a255-af99-440b-bdcd-712401c04b66"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:13.194532 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] validate_networks() for [('c851a255-af99-440b-bdcd-712401c04b66', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:29:13.414609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bf95e585-7e7d-4920-ae2d-7dcf4a280814 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:13.415250 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bf95e585-7e7d-4920-ae2d-7dcf4a280814 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:13.423311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf95e585-7e7d-4920-ae2d-7dcf4a280814 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:13.426722 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf95e585-7e7d-4920-ae2d-7dcf4a280814 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:13.426722 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf95e585-7e7d-4920-ae2d-7dcf4a280814 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:13.426722 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf95e585-7e7d-4920-ae2d-7dcf4a280814 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:13.426722 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf95e585-7e7d-4920-ae2d-7dcf4a280814 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:13.427098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf95e585-7e7d-4920-ae2d-7dcf4a280814 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:13.574024 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bf95e585-7e7d-4920-ae2d-7dcf4a280814 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:13.582494 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bf95e585-7e7d-4920-ae2d-7dcf4a280814 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.171791 Sep 15 19:29:13.583083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 142/273] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:13 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:13.602674 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:29:13.603623 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:29:13.604644 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:29:13.605422 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:29:13.606183 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:29:13.616820 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:13.617240 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:13.617694 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:13.618432 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:13.618889 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:13.619314 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:13.636873 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Getting quotas for project 4fd3f2da26af4d3db4c6db4ceb851558. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:29:13.640764 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Getting quotas for user fd8d3fe4be354995b1698b9783ce6c65 and project 4fd3f2da26af4d3db4c6db4ceb851558. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:29:13.652356 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:29:13.654483 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51f1c951-5346-46bb-9d9b-745fd411b36c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:29:13.749786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-369bde2b-2326-47bc-8820-9e85efa8dcd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:13.750430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-369bde2b-2326-47bc-8820-9e85efa8dcd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:13.757259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-369bde2b-2326-47bc-8820-9e85efa8dcd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:13.757869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-369bde2b-2326-47bc-8820-9e85efa8dcd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:13.758033 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-731ffcc9-c8f8-4c24-bcef-135aace1b9a6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620724 Sep 15 19:29:13.758202 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-369bde2b-2326-47bc-8820-9e85efa8dcd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:13.764395 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 132/274] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:29:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 19:29:13.764602 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-369bde2b-2326-47bc-8820-9e85efa8dcd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:13.764602 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-369bde2b-2326-47bc-8820-9e85efa8dcd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:13.764602 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-369bde2b-2326-47bc-8820-9e85efa8dcd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:13.770837 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b0ca5a46-bc10-4559-b5f9-b70bcb7d13cf tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:13.771372 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b0ca5a46-bc10-4559-b5f9-b70bcb7d13cf tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:13.842845 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b0ca5a46-bc10-4559-b5f9-b70bcb7d13cf tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:13.850639 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b0ca5a46-bc10-4559-b5f9-b70bcb7d13cf tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1257 microversion: 2.1 time: 0.083186 Sep 15 19:29:13.851688 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 133/275] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:13 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1257 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:13.874365 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ccd37f4c-2439-4470-a86f-d475cbd08b88 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:13.875189 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ccd37f4c-2439-4470-a86f-d475cbd08b88 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:13.888177 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccd37f4c-2439-4470-a86f-d475cbd08b88 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:13.888816 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccd37f4c-2439-4470-a86f-d475cbd08b88 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:13.889335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccd37f4c-2439-4470-a86f-d475cbd08b88 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:13.890256 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccd37f4c-2439-4470-a86f-d475cbd08b88 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:13.890852 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccd37f4c-2439-4470-a86f-d475cbd08b88 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:13.891450 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccd37f4c-2439-4470-a86f-d475cbd08b88 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:13.922780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-369bde2b-2326-47bc-8820-9e85efa8dcd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:13.939336 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-369bde2b-2326-47bc-8820-9e85efa8dcd7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.193727 Sep 15 19:29:13.939955 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 143/276] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:13 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:13.961764 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ccd37f4c-2439-4470-a86f-d475cbd08b88 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:13.969591 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ccd37f4c-2439-4470-a86f-d475cbd08b88 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1248 microversion: 2.1 time: 0.100619 Sep 15 19:29:13.970234 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 134/277] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:13 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1248 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:14.613839 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6ffdfb7f-6bf4-4cc9-a76c-04c83d814a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:14.614662 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6ffdfb7f-6bf4-4cc9-a76c-04c83d814a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:14.622770 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ffdfb7f-6bf4-4cc9-a76c-04c83d814a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:14.623487 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ffdfb7f-6bf4-4cc9-a76c-04c83d814a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:14.624089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ffdfb7f-6bf4-4cc9-a76c-04c83d814a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:14.625656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ffdfb7f-6bf4-4cc9-a76c-04c83d814a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:14.625656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ffdfb7f-6bf4-4cc9-a76c-04c83d814a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:14.627130 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ffdfb7f-6bf4-4cc9-a76c-04c83d814a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:14.794515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6ffdfb7f-6bf4-4cc9-a76c-04c83d814a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:14.802639 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6ffdfb7f-6bf4-4cc9-a76c-04c83d814a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.192943 Sep 15 19:29:14.803211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 144/278] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:14 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:14.877178 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7eefd973-e960-4270-a909-70694ccad2ef tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:14.877900 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7eefd973-e960-4270-a909-70694ccad2ef tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:14.936119 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7eefd973-e960-4270-a909-70694ccad2ef tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:14.943301 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7eefd973-e960-4270-a909-70694ccad2ef tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1257 microversion: 2.1 time: 0.070248 Sep 15 19:29:14.944505 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 135/279] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:14 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:14.963270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-857ce324-c804-4b13-8305-09e23cab5a28 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:14.963981 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-857ce324-c804-4b13-8305-09e23cab5a28 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:14.970525 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-857ce324-c804-4b13-8305-09e23cab5a28 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:14.971006 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-857ce324-c804-4b13-8305-09e23cab5a28 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:14.971441 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-857ce324-c804-4b13-8305-09e23cab5a28 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:14.972303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-857ce324-c804-4b13-8305-09e23cab5a28 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:14.972793 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-857ce324-c804-4b13-8305-09e23cab5a28 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:14.973210 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-857ce324-c804-4b13-8305-09e23cab5a28 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:14.997199 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-26e228e6-666a-492e-a4e6-142db074ecd1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:14.997898 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-26e228e6-666a-492e-a4e6-142db074ecd1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:15.005353 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26e228e6-666a-492e-a4e6-142db074ecd1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:15.005836 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26e228e6-666a-492e-a4e6-142db074ecd1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:15.006273 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26e228e6-666a-492e-a4e6-142db074ecd1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:15.007500 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26e228e6-666a-492e-a4e6-142db074ecd1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:15.007987 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26e228e6-666a-492e-a4e6-142db074ecd1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:15.008413 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26e228e6-666a-492e-a4e6-142db074ecd1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:15.075397 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-26e228e6-666a-492e-a4e6-142db074ecd1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:15.083551 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-26e228e6-666a-492e-a4e6-142db074ecd1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1296 microversion: 2.1 time: 0.092972 Sep 15 19:29:15.084368 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 136/280] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:14 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:15.110674 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-857ce324-c804-4b13-8305-09e23cab5a28 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:15.118766 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-857ce324-c804-4b13-8305-09e23cab5a28 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.160212 Sep 15 19:29:15.119252 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 145/281] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:14 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:15.829267 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-daa78e68-2585-4cb6-a1c0-bc39c887e920 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:15.830237 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-daa78e68-2585-4cb6-a1c0-bc39c887e920 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:15.838153 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa78e68-2585-4cb6-a1c0-bc39c887e920 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:15.842840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa78e68-2585-4cb6-a1c0-bc39c887e920 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:15.842840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa78e68-2585-4cb6-a1c0-bc39c887e920 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:15.842840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa78e68-2585-4cb6-a1c0-bc39c887e920 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:15.842840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa78e68-2585-4cb6-a1c0-bc39c887e920 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:15.843206 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa78e68-2585-4cb6-a1c0-bc39c887e920 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:15.967781 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dc245fb0-40f8-472c-af88-20bafd640a50 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:15.968479 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-dc245fb0-40f8-472c-af88-20bafd640a50 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:15.976039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dc245fb0-40f8-472c-af88-20bafd640a50 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:15.976784 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dc245fb0-40f8-472c-af88-20bafd640a50 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:15.977605 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dc245fb0-40f8-472c-af88-20bafd640a50 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:15.978512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dc245fb0-40f8-472c-af88-20bafd640a50 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:15.979150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dc245fb0-40f8-472c-af88-20bafd640a50 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:15.982876 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-daa78e68-2585-4cb6-a1c0-bc39c887e920 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:15.984082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dc245fb0-40f8-472c-af88-20bafd640a50 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:16.003958 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-daa78e68-2585-4cb6-a1c0-bc39c887e920 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.168968 Sep 15 19:29:16.003958 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 137/282] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:15 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:16.052970 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dc245fb0-40f8-472c-af88-20bafd640a50 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:16.061231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dc245fb0-40f8-472c-af88-20bafd640a50 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1261 microversion: 2.1 time: 0.098311 Sep 15 19:29:16.064548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 146/283] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:15 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1261 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:16.106860 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b7dd53e0-9a2c-4de8-ae29-538b5279ccd2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:16.107492 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b7dd53e0-9a2c-4de8-ae29-538b5279ccd2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:16.113461 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7dd53e0-9a2c-4de8-ae29-538b5279ccd2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:16.113947 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7dd53e0-9a2c-4de8-ae29-538b5279ccd2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:16.114387 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7dd53e0-9a2c-4de8-ae29-538b5279ccd2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:16.115083 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7dd53e0-9a2c-4de8-ae29-538b5279ccd2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:16.115534 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7dd53e0-9a2c-4de8-ae29-538b5279ccd2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:16.116039 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7dd53e0-9a2c-4de8-ae29-538b5279ccd2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:16.142434 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-90b97121-e509-4aeb-862c-dfd5699f4624 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:16.143106 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-90b97121-e509-4aeb-862c-dfd5699f4624 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:16.150443 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90b97121-e509-4aeb-862c-dfd5699f4624 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:16.150989 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90b97121-e509-4aeb-862c-dfd5699f4624 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:16.151424 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90b97121-e509-4aeb-862c-dfd5699f4624 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:16.152161 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90b97121-e509-4aeb-862c-dfd5699f4624 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:16.152612 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90b97121-e509-4aeb-862c-dfd5699f4624 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:16.153114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90b97121-e509-4aeb-862c-dfd5699f4624 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:16.188373 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b7dd53e0-9a2c-4de8-ae29-538b5279ccd2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:16.196358 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b7dd53e0-9a2c-4de8-ae29-538b5279ccd2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1296 microversion: 2.1 time: 0.093480 Sep 15 19:29:16.197018 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 138/284] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:16 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:16.296963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-90b97121-e509-4aeb-862c-dfd5699f4624 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:16.304998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-90b97121-e509-4aeb-862c-dfd5699f4624 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.166409 Sep 15 19:29:16.305550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 147/285] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:16 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:17.015840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c18bd441-d48b-4da2-8bb6-2b80aacfd565 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:17.016448 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c18bd441-d48b-4da2-8bb6-2b80aacfd565 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:17.023198 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c18bd441-d48b-4da2-8bb6-2b80aacfd565 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:17.023839 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c18bd441-d48b-4da2-8bb6-2b80aacfd565 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:17.024278 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c18bd441-d48b-4da2-8bb6-2b80aacfd565 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:17.024979 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c18bd441-d48b-4da2-8bb6-2b80aacfd565 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:17.025444 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c18bd441-d48b-4da2-8bb6-2b80aacfd565 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:17.025862 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c18bd441-d48b-4da2-8bb6-2b80aacfd565 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:17.030912 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:17.085760 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-54e9b0ab-df2d-4bdd-bcf7-9f952c889775 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:17.086428 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-54e9b0ab-df2d-4bdd-bcf7-9f952c889775 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:17.094003 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54e9b0ab-df2d-4bdd-bcf7-9f952c889775 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:17.094483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54e9b0ab-df2d-4bdd-bcf7-9f952c889775 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:17.094914 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54e9b0ab-df2d-4bdd-bcf7-9f952c889775 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:17.095615 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54e9b0ab-df2d-4bdd-bcf7-9f952c889775 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:17.096083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54e9b0ab-df2d-4bdd-bcf7-9f952c889775 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:17.096503 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54e9b0ab-df2d-4bdd-bcf7-9f952c889775 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:17.163457 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-54e9b0ab-df2d-4bdd-bcf7-9f952c889775 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:17.169072 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c18bd441-d48b-4da2-8bb6-2b80aacfd565 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:17.173849 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-54e9b0ab-df2d-4bdd-bcf7-9f952c889775 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1309 microversion: 2.1 time: 0.093285 Sep 15 19:29:17.174440 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 148/286] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:17 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:17.177696 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c18bd441-d48b-4da2-8bb6-2b80aacfd565 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.165678 Sep 15 19:29:17.179352 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 139/287] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:17 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:17.219140 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4ad446b0-4e0d-44a7-b121-961a171cba97 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:17.220174 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4ad446b0-4e0d-44a7-b121-961a171cba97 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:17.222802 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:17.236599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ad446b0-4e0d-44a7-b121-961a171cba97 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:17.236599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ad446b0-4e0d-44a7-b121-961a171cba97 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:17.236599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ad446b0-4e0d-44a7-b121-961a171cba97 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:17.236599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ad446b0-4e0d-44a7-b121-961a171cba97 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:17.237144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ad446b0-4e0d-44a7-b121-961a171cba97 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:17.237144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ad446b0-4e0d-44a7-b121-961a171cba97 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:17.313782 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4ad446b0-4e0d-44a7-b121-961a171cba97 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:17.322317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4ad446b0-4e0d-44a7-b121-961a171cba97 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1302 microversion: 2.1 time: 0.106981 Sep 15 19:29:17.323711 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 149/288] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:17 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1302 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:17.328333 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8aa103dd-c246-488b-915b-d1e0948e8a9f tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:17.329044 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8aa103dd-c246-488b-915b-d1e0948e8a9f tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:17.337253 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aa103dd-c246-488b-915b-d1e0948e8a9f tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:17.338499 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aa103dd-c246-488b-915b-d1e0948e8a9f tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:17.339185 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aa103dd-c246-488b-915b-d1e0948e8a9f tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:17.340246 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aa103dd-c246-488b-915b-d1e0948e8a9f tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:17.340909 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aa103dd-c246-488b-915b-d1e0948e8a9f tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:17.341715 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aa103dd-c246-488b-915b-d1e0948e8a9f tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:17.499388 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8aa103dd-c246-488b-915b-d1e0948e8a9f tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:17.508181 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8aa103dd-c246-488b-915b-d1e0948e8a9f tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.183512 Sep 15 19:29:17.513135 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 140/289] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:17 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:18.214776 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-58fef582-6e70-42ec-b70b-dc012472c079 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:18.216252 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f72aebcf-d557-4f46-b9a3-ea2a06450d21 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:18.218264 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f72aebcf-d557-4f46-b9a3-ea2a06450d21 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:18.224651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-58fef582-6e70-42ec-b70b-dc012472c079 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:18.235935 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-58fef582-6e70-42ec-b70b-dc012472c079 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:18.236788 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-58fef582-6e70-42ec-b70b-dc012472c079 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:18.237248 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72aebcf-d557-4f46-b9a3-ea2a06450d21 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:18.237785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72aebcf-d557-4f46-b9a3-ea2a06450d21 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:18.238228 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72aebcf-d557-4f46-b9a3-ea2a06450d21 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:18.238407 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-58fef582-6e70-42ec-b70b-dc012472c079 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:18.238915 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72aebcf-d557-4f46-b9a3-ea2a06450d21 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:18.239496 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72aebcf-d557-4f46-b9a3-ea2a06450d21 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:18.239949 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-58fef582-6e70-42ec-b70b-dc012472c079 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:18.240233 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72aebcf-d557-4f46-b9a3-ea2a06450d21 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:18.242269 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-58fef582-6e70-42ec-b70b-dc012472c079 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:18.243393 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-58fef582-6e70-42ec-b70b-dc012472c079 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:18.365359 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f72aebcf-d557-4f46-b9a3-ea2a06450d21 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:18.376547 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f72aebcf-d557-4f46-b9a3-ea2a06450d21 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1315 microversion: 2.1 time: 0.176152 Sep 15 19:29:18.379034 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 141/290] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:18 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:18.390879 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-58531ffd-8b90-4bce-9b23-d1dc3a4db28d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:18.393924 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-58531ffd-8b90-4bce-9b23-d1dc3a4db28d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:18.426380 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58531ffd-8b90-4bce-9b23-d1dc3a4db28d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:18.426917 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58531ffd-8b90-4bce-9b23-d1dc3a4db28d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:18.427345 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58531ffd-8b90-4bce-9b23-d1dc3a4db28d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:18.430060 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58531ffd-8b90-4bce-9b23-d1dc3a4db28d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:18.430849 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58531ffd-8b90-4bce-9b23-d1dc3a4db28d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:18.431269 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58531ffd-8b90-4bce-9b23-d1dc3a4db28d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:18.643699 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-58531ffd-8b90-4bce-9b23-d1dc3a4db28d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:18.659544 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-58531ffd-8b90-4bce-9b23-d1dc3a4db28d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.279001 Sep 15 19:29:18.660975 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 142/291] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:18 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:18.672151 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b62539e-9765-4535-a1b1-f009cd2d001d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:18.673758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8b62539e-9765-4535-a1b1-f009cd2d001d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:18.684014 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:18.686602 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b62539e-9765-4535-a1b1-f009cd2d001d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:18.687640 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b62539e-9765-4535-a1b1-f009cd2d001d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:18.688451 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b62539e-9765-4535-a1b1-f009cd2d001d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:18.689880 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b62539e-9765-4535-a1b1-f009cd2d001d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:18.692168 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b62539e-9765-4535-a1b1-f009cd2d001d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:18.692934 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b62539e-9765-4535-a1b1-f009cd2d001d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:18.750624 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-58fef582-6e70-42ec-b70b-dc012472c079 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:18.771124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-58fef582-6e70-42ec-b70b-dc012472c079 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.571244 Sep 15 19:29:18.778246 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 150/292] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:18 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:18.984441 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8b62539e-9765-4535-a1b1-f009cd2d001d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:18.994759 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8b62539e-9765-4535-a1b1-f009cd2d001d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.331510 Sep 15 19:29:18.996853 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 143/293] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:18 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:19.415431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-005b77cf-a7f2-46b0-9536-c8427536cdb8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:19.417547 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-005b77cf-a7f2-46b0-9536-c8427536cdb8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:19.424826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-005b77cf-a7f2-46b0-9536-c8427536cdb8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:19.425541 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-005b77cf-a7f2-46b0-9536-c8427536cdb8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:19.426362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-005b77cf-a7f2-46b0-9536-c8427536cdb8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:19.430486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-005b77cf-a7f2-46b0-9536-c8427536cdb8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:19.432097 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-005b77cf-a7f2-46b0-9536-c8427536cdb8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:19.432929 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-005b77cf-a7f2-46b0-9536-c8427536cdb8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:19.683679 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e087df9d-c964-4303-a7f6-2c76ae636e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:19.684299 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e087df9d-c964-4303-a7f6-2c76ae636e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:19.690723 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e087df9d-c964-4303-a7f6-2c76ae636e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:19.695048 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e087df9d-c964-4303-a7f6-2c76ae636e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:19.699143 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e087df9d-c964-4303-a7f6-2c76ae636e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:19.699143 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e087df9d-c964-4303-a7f6-2c76ae636e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:19.699143 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e087df9d-c964-4303-a7f6-2c76ae636e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:19.699143 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e087df9d-c964-4303-a7f6-2c76ae636e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:19.745517 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-005b77cf-a7f2-46b0-9536-c8427536cdb8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:19.756210 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-005b77cf-a7f2-46b0-9536-c8427536cdb8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.345318 Sep 15 19:29:19.759819 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 151/294] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:19 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:19.802676 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-52eebccd-43a3-4b65-bc97-37e1a8dc20ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:19.802676 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-52eebccd-43a3-4b65-bc97-37e1a8dc20ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:19.815328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52eebccd-43a3-4b65-bc97-37e1a8dc20ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:19.816195 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52eebccd-43a3-4b65-bc97-37e1a8dc20ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:19.816872 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52eebccd-43a3-4b65-bc97-37e1a8dc20ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:19.818049 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52eebccd-43a3-4b65-bc97-37e1a8dc20ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:19.818748 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52eebccd-43a3-4b65-bc97-37e1a8dc20ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:19.819388 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52eebccd-43a3-4b65-bc97-37e1a8dc20ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:19.894156 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e087df9d-c964-4303-a7f6-2c76ae636e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:19.906013 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e087df9d-c964-4303-a7f6-2c76ae636e76 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.225923 Sep 15 19:29:19.917604 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 144/295] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:19 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:20.025083 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e38ced72-7e89-4e3b-b46d-1a619da47f44 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:20.025697 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e38ced72-7e89-4e3b-b46d-1a619da47f44 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:20.039532 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e38ced72-7e89-4e3b-b46d-1a619da47f44 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:20.040058 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e38ced72-7e89-4e3b-b46d-1a619da47f44 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:20.040733 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e38ced72-7e89-4e3b-b46d-1a619da47f44 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:20.041446 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e38ced72-7e89-4e3b-b46d-1a619da47f44 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:20.042078 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e38ced72-7e89-4e3b-b46d-1a619da47f44 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:20.042659 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e38ced72-7e89-4e3b-b46d-1a619da47f44 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:20.142060 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-52eebccd-43a3-4b65-bc97-37e1a8dc20ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:20.151789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-52eebccd-43a3-4b65-bc97-37e1a8dc20ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.354780 Sep 15 19:29:20.152377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 152/296] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:19 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:20.315823 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e38ced72-7e89-4e3b-b46d-1a619da47f44 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:20.348198 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e38ced72-7e89-4e3b-b46d-1a619da47f44 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.327046 Sep 15 19:29:20.349577 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 145/297] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:20 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:20.524847 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-df6a90df-df59-45c0-8049-37556a838795 req-ae33f5cb-5f57-46e1-ad5a-bb78d0c4b5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "212105c1-8435-430c-9ffa-72e8a6bd2426", "tag": "e07717f9-44fe-4be0-919e-d14afd6d6dcf"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:20.544480 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-df6a90df-df59-45c0-8049-37556a838795 req-ae33f5cb-5f57-46e1-ad5a-bb78d0c4b5e4 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:20.546422 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-df6a90df-df59-45c0-8049-37556a838795 req-ae33f5cb-5f57-46e1-ad5a-bb78d0c4b5e4 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:20.548179 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-df6a90df-df59-45c0-8049-37556a838795 req-ae33f5cb-5f57-46e1-ad5a-bb78d0c4b5e4 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:20.564142 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-df6a90df-df59-45c0-8049-37556a838795 req-ae33f5cb-5f57-46e1-ad5a-bb78d0c4b5e4 service nova] Creating event network-changed:e07717f9-44fe-4be0-919e-d14afd6d6dcf for instance 212105c1-8435-430c-9ffa-72e8a6bd2426 on hv-cinder-84984 Sep 15 19:29:20.571736 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-df6a90df-df59-45c0-8049-37556a838795 req-ae33f5cb-5f57-46e1-ad5a-bb78d0c4b5e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051467 Sep 15 19:29:20.578611 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 153/298] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:20.662852 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-38ecbd99-901d-42ab-ae15-b176b37f850a req-24c5e60b-4407-49dd-8843-ecadb4ad1ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4836cd00-5dd6-454d-84d6-643e1c0843c2", "name": "network-vif-plugged", "status": "completed", "tag": "6a575adf-3c82-4218-b116-aeb619bfddcc"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:20.698785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-38ecbd99-901d-42ab-ae15-b176b37f850a req-24c5e60b-4407-49dd-8843-ecadb4ad1ef0 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:20.705381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-38ecbd99-901d-42ab-ae15-b176b37f850a req-24c5e60b-4407-49dd-8843-ecadb4ad1ef0 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:20.706106 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-38ecbd99-901d-42ab-ae15-b176b37f850a req-24c5e60b-4407-49dd-8843-ecadb4ad1ef0 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:20.728559 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-38ecbd99-901d-42ab-ae15-b176b37f850a req-24c5e60b-4407-49dd-8843-ecadb4ad1ef0 service nova] Creating event network-vif-plugged:6a575adf-3c82-4218-b116-aeb619bfddcc for instance 4836cd00-5dd6-454d-84d6-643e1c0843c2 on hv-cinder-84984 Sep 15 19:29:20.750662 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-38ecbd99-901d-42ab-ae15-b176b37f850a req-24c5e60b-4407-49dd-8843-ecadb4ad1ef0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101221 Sep 15 19:29:20.751619 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 146/299] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:20.784154 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-67ee604d-a5ae-4cca-86a7-bc5705750cb6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:20.789473 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-67ee604d-a5ae-4cca-86a7-bc5705750cb6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:20.819717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67ee604d-a5ae-4cca-86a7-bc5705750cb6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:20.821813 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67ee604d-a5ae-4cca-86a7-bc5705750cb6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:20.824852 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67ee604d-a5ae-4cca-86a7-bc5705750cb6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:20.825853 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67ee604d-a5ae-4cca-86a7-bc5705750cb6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:20.827562 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67ee604d-a5ae-4cca-86a7-bc5705750cb6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:20.828299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67ee604d-a5ae-4cca-86a7-bc5705750cb6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:20.941190 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e84320f-0912-4a97-9d1e-61ee07fb82fa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:20.942417 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e84320f-0912-4a97-9d1e-61ee07fb82fa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:20.957600 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e84320f-0912-4a97-9d1e-61ee07fb82fa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:20.958817 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e84320f-0912-4a97-9d1e-61ee07fb82fa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:20.962165 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e84320f-0912-4a97-9d1e-61ee07fb82fa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:20.963175 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e84320f-0912-4a97-9d1e-61ee07fb82fa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:20.965248 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e84320f-0912-4a97-9d1e-61ee07fb82fa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:20.966466 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e84320f-0912-4a97-9d1e-61ee07fb82fa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:21.492306 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-67ee604d-a5ae-4cca-86a7-bc5705750cb6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:21.492687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2e84320f-0912-4a97-9d1e-61ee07fb82fa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:21.521494 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e84320f-0912-4a97-9d1e-61ee07fb82fa tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.587738 Sep 15 19:29:21.522092 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-67ee604d-a5ae-4cca-86a7-bc5705750cb6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.742051 Sep 15 19:29:21.525646 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 147/300] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:20 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:21.544125 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 154/301] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:20 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:21.563856 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5bcb1797-c36a-4e72-abdc-70edc6086161 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:21.564991 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-92e0c9e4-7ab3-4a44-b8c9-737d3ea04ebd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:21.565912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5bcb1797-c36a-4e72-abdc-70edc6086161 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:21.567571 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-92e0c9e4-7ab3-4a44-b8c9-737d3ea04ebd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:21.591842 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92e0c9e4-7ab3-4a44-b8c9-737d3ea04ebd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:21.592976 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92e0c9e4-7ab3-4a44-b8c9-737d3ea04ebd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:21.593319 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5bcb1797-c36a-4e72-abdc-70edc6086161 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:21.597204 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5bcb1797-c36a-4e72-abdc-70edc6086161 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:21.597659 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92e0c9e4-7ab3-4a44-b8c9-737d3ea04ebd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:21.598288 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5bcb1797-c36a-4e72-abdc-70edc6086161 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:21.599190 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92e0c9e4-7ab3-4a44-b8c9-737d3ea04ebd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:21.601809 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92e0c9e4-7ab3-4a44-b8c9-737d3ea04ebd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:21.604131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5bcb1797-c36a-4e72-abdc-70edc6086161 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:21.604353 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92e0c9e4-7ab3-4a44-b8c9-737d3ea04ebd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:21.607274 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5bcb1797-c36a-4e72-abdc-70edc6086161 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:21.607947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5bcb1797-c36a-4e72-abdc-70edc6086161 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:21.947866 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5bcb1797-c36a-4e72-abdc-70edc6086161 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:21.957173 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5bcb1797-c36a-4e72-abdc-70edc6086161 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.411243 Sep 15 19:29:21.960918 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 155/302] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:21 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:22.344674 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-92e0c9e4-7ab3-4a44-b8c9-737d3ea04ebd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:22.356642 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-92e0c9e4-7ab3-4a44-b8c9-737d3ea04ebd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.809481 Sep 15 19:29:22.357291 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 148/303] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:21 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:22.557213 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8a3ad83c-a045-4173-9276-63d33c1651e4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:22.557837 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8a3ad83c-a045-4173-9276-63d33c1651e4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:22.560040 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-61528492-3677-4f2a-a200-2a2795099ad9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:22.563502 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-61528492-3677-4f2a-a200-2a2795099ad9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:22.575162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-61528492-3677-4f2a-a200-2a2795099ad9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:22.575518 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a3ad83c-a045-4173-9276-63d33c1651e4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:22.575992 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-61528492-3677-4f2a-a200-2a2795099ad9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:22.576111 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a3ad83c-a045-4173-9276-63d33c1651e4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:22.576459 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a3ad83c-a045-4173-9276-63d33c1651e4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:22.577066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-61528492-3677-4f2a-a200-2a2795099ad9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:22.577203 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a3ad83c-a045-4173-9276-63d33c1651e4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:22.577594 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a3ad83c-a045-4173-9276-63d33c1651e4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:22.578035 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a3ad83c-a045-4173-9276-63d33c1651e4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:22.578647 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-61528492-3677-4f2a-a200-2a2795099ad9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:22.579279 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-61528492-3677-4f2a-a200-2a2795099ad9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:22.579876 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-61528492-3677-4f2a-a200-2a2795099ad9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:22.812456 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8a3ad83c-a045-4173-9276-63d33c1651e4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:22.828512 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8a3ad83c-a045-4173-9276-63d33c1651e4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.281095 Sep 15 19:29:22.845083 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 149/304] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:22 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:22.845083 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0f8d0ef8-ed3f-44de-92df-3688b8809896 req-9cc1211f-8df8-43e2-ac66-23107f440376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdce58c-be13-4f4a-8a24-b3f3f002d77d", "tag": "1d0a2bca-ad01-4592-b8f5-ddac6af30dc4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:22.862242 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-61528492-3677-4f2a-a200-2a2795099ad9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:22.869000 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:22.882086 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-61528492-3677-4f2a-a200-2a2795099ad9 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.336977 Sep 15 19:29:22.884719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 156/305] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:22 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:22.891006 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-60cc8a88-4d6d-4ecb-b554-ca17b39ed252 req-41b7ad84-5ec0-43ef-8a52-a719d8b6c5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6cfa71-df2d-4e56-ba89-35f6153f327f", "name": "network-vif-plugged", "status": "completed", "tag": "f848c54c-bc13-4277-851b-f4482d166911"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:22.897570 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0f8d0ef8-ed3f-44de-92df-3688b8809896 req-9cc1211f-8df8-43e2-ac66-23107f440376 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:22.905243 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0f8d0ef8-ed3f-44de-92df-3688b8809896 req-9cc1211f-8df8-43e2-ac66-23107f440376 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:22.906700 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0f8d0ef8-ed3f-44de-92df-3688b8809896 req-9cc1211f-8df8-43e2-ac66-23107f440376 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:22.919774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-60cc8a88-4d6d-4ecb-b554-ca17b39ed252 req-41b7ad84-5ec0-43ef-8a52-a719d8b6c5a7 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:22.923528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-60cc8a88-4d6d-4ecb-b554-ca17b39ed252 req-41b7ad84-5ec0-43ef-8a52-a719d8b6c5a7 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:22.924253 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-60cc8a88-4d6d-4ecb-b554-ca17b39ed252 req-41b7ad84-5ec0-43ef-8a52-a719d8b6c5a7 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:22.932676 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=6 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:22.947534 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0f8d0ef8-ed3f-44de-92df-3688b8809896 req-9cc1211f-8df8-43e2-ac66-23107f440376 service nova] Creating event network-changed:1d0a2bca-ad01-4592-b8f5-ddac6af30dc4 for instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d on hv-cinder-84984 Sep 15 19:29:22.960893 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0f8d0ef8-ed3f-44de-92df-3688b8809896 req-9cc1211f-8df8-43e2-ac66-23107f440376 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129221 Sep 15 19:29:22.969146 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 150/306] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:22.971159 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-60cc8a88-4d6d-4ecb-b554-ca17b39ed252 req-41b7ad84-5ec0-43ef-8a52-a719d8b6c5a7 service nova] Creating event network-vif-plugged:f848c54c-bc13-4277-851b-f4482d166911 for instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f on hv-cinder-84984 Sep 15 19:29:22.983323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-60cc8a88-4d6d-4ecb-b554-ca17b39ed252 req-41b7ad84-5ec0-43ef-8a52-a719d8b6c5a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096995 Sep 15 19:29:22.985876 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 157/307] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:22.989369 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f3fdcf57-383c-4e83-bd60-8ab33f5c77fe tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:22.989369 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f3fdcf57-383c-4e83-bd60-8ab33f5c77fe tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:23.001020 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf57-383c-4e83-bd60-8ab33f5c77fe tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:23.002114 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf57-383c-4e83-bd60-8ab33f5c77fe tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:23.002831 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf57-383c-4e83-bd60-8ab33f5c77fe tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:23.004062 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf57-383c-4e83-bd60-8ab33f5c77fe tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:23.005589 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf57-383c-4e83-bd60-8ab33f5c77fe tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:23.006586 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf57-383c-4e83-bd60-8ab33f5c77fe tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:23.239419 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f3fdcf57-383c-4e83-bd60-8ab33f5c77fe tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:23.249793 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f3fdcf57-383c-4e83-bd60-8ab33f5c77fe tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.265608 Sep 15 19:29:23.250197 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 151/308] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:22 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:23.382869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-be97823f-bb5c-42e9-9c00-5fea642b1d75 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:23.383689 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-be97823f-bb5c-42e9-9c00-5fea642b1d75 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:23.391909 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-be97823f-bb5c-42e9-9c00-5fea642b1d75 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:23.392721 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-be97823f-bb5c-42e9-9c00-5fea642b1d75 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:23.393210 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-be97823f-bb5c-42e9-9c00-5fea642b1d75 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:23.393926 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-be97823f-bb5c-42e9-9c00-5fea642b1d75 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:23.394383 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-be97823f-bb5c-42e9-9c00-5fea642b1d75 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:23.394805 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-be97823f-bb5c-42e9-9c00-5fea642b1d75 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:23.540501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-be97823f-bb5c-42e9-9c00-5fea642b1d75 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:23.548536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-be97823f-bb5c-42e9-9c00-5fea642b1d75 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.170718 Sep 15 19:29:23.549094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 158/309] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:23 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:23.862460 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-699ad170-4973-410e-b72a-e6390ede794a tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:23.863687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-699ad170-4973-410e-b72a-e6390ede794a tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:23.865794 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:23.875540 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-699ad170-4973-410e-b72a-e6390ede794a tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:23.875540 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-699ad170-4973-410e-b72a-e6390ede794a tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:23.875540 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-699ad170-4973-410e-b72a-e6390ede794a tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:23.875540 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-699ad170-4973-410e-b72a-e6390ede794a tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:23.875938 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-699ad170-4973-410e-b72a-e6390ede794a tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:23.875938 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-699ad170-4973-410e-b72a-e6390ede794a tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:23.913695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a4c7142b-1ce7-47f5-83c3-56cae7a65558 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:23.914568 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a4c7142b-1ce7-47f5-83c3-56cae7a65558 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:23.922991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a4c7142b-1ce7-47f5-83c3-56cae7a65558 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:23.923730 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a4c7142b-1ce7-47f5-83c3-56cae7a65558 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:23.924452 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a4c7142b-1ce7-47f5-83c3-56cae7a65558 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:23.925367 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a4c7142b-1ce7-47f5-83c3-56cae7a65558 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:23.926092 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a4c7142b-1ce7-47f5-83c3-56cae7a65558 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:23.926737 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a4c7142b-1ce7-47f5-83c3-56cae7a65558 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:24.075003 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-699ad170-4973-410e-b72a-e6390ede794a tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:24.089278 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-699ad170-4973-410e-b72a-e6390ede794a tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.230516 Sep 15 19:29:24.106768 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 152/310] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:23 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:24.153778 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a4c7142b-1ce7-47f5-83c3-56cae7a65558 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:24.157781 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a4c7142b-1ce7-47f5-83c3-56cae7a65558 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.250574 Sep 15 19:29:24.158462 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 159/311] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:23 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:24.272388 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4fbf7917-52ea-4dae-8511-7720b9d6ddc3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:24.273004 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4fbf7917-52ea-4dae-8511-7720b9d6ddc3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:24.279823 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fbf7917-52ea-4dae-8511-7720b9d6ddc3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:24.280589 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fbf7917-52ea-4dae-8511-7720b9d6ddc3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:24.281213 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fbf7917-52ea-4dae-8511-7720b9d6ddc3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:24.282276 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fbf7917-52ea-4dae-8511-7720b9d6ddc3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:24.282883 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fbf7917-52ea-4dae-8511-7720b9d6ddc3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:24.283461 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fbf7917-52ea-4dae-8511-7720b9d6ddc3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:24.479916 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4fbf7917-52ea-4dae-8511-7720b9d6ddc3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:24.500074 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4fbf7917-52ea-4dae-8511-7720b9d6ddc3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.231414 Sep 15 19:29:24.500919 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 153/312] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:24 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:24.573402 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-67ce1c4c-26a0-4880-a1de-ee7b6b203b55 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:24.574388 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-67ce1c4c-26a0-4880-a1de-ee7b6b203b55 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:24.585838 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67ce1c4c-26a0-4880-a1de-ee7b6b203b55 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:24.587078 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67ce1c4c-26a0-4880-a1de-ee7b6b203b55 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:24.588115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67ce1c4c-26a0-4880-a1de-ee7b6b203b55 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:24.589275 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67ce1c4c-26a0-4880-a1de-ee7b6b203b55 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:24.590273 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67ce1c4c-26a0-4880-a1de-ee7b6b203b55 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:24.590805 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67ce1c4c-26a0-4880-a1de-ee7b6b203b55 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:24.783677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-67ce1c4c-26a0-4880-a1de-ee7b6b203b55 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:24.796533 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-67ce1c4c-26a0-4880-a1de-ee7b6b203b55 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.227779 Sep 15 19:29:24.797551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 160/313] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:24 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:25.114993 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a3b3fda4-298d-4a07-ba46-5b5e5ed3e7c4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:25.116762 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a3b3fda4-298d-4a07-ba46-5b5e5ed3e7c4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:25.119127 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=30 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:25.124059 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3b3fda4-298d-4a07-ba46-5b5e5ed3e7c4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:25.124637 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3b3fda4-298d-4a07-ba46-5b5e5ed3e7c4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:25.125034 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3b3fda4-298d-4a07-ba46-5b5e5ed3e7c4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:25.125888 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3b3fda4-298d-4a07-ba46-5b5e5ed3e7c4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:25.126362 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3b3fda4-298d-4a07-ba46-5b5e5ed3e7c4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:25.126793 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3b3fda4-298d-4a07-ba46-5b5e5ed3e7c4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:25.185240 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-69d2773e-c071-4255-94f3-34e2ea8fb164 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:25.185854 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-69d2773e-c071-4255-94f3-34e2ea8fb164 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:25.193349 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69d2773e-c071-4255-94f3-34e2ea8fb164 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:25.197440 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69d2773e-c071-4255-94f3-34e2ea8fb164 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:25.197440 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69d2773e-c071-4255-94f3-34e2ea8fb164 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:25.208964 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69d2773e-c071-4255-94f3-34e2ea8fb164 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:25.210074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69d2773e-c071-4255-94f3-34e2ea8fb164 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:25.210074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69d2773e-c071-4255-94f3-34e2ea8fb164 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:25.341997 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a3b3fda4-298d-4a07-ba46-5b5e5ed3e7c4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:25.351160 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a3b3fda4-298d-4a07-ba46-5b5e5ed3e7c4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.240028 Sep 15 19:29:25.359108 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 154/314] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:25 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:25.416637 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-69d2773e-c071-4255-94f3-34e2ea8fb164 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:25.425861 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-69d2773e-c071-4255-94f3-34e2ea8fb164 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.244414 Sep 15 19:29:25.426478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 161/315] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:25 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:25.528676 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-74a4af35-d4ac-461d-ae43-6965014cd2cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:25.529288 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-74a4af35-d4ac-461d-ae43-6965014cd2cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:25.536118 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74a4af35-d4ac-461d-ae43-6965014cd2cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:25.536601 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74a4af35-d4ac-461d-ae43-6965014cd2cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:25.537033 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74a4af35-d4ac-461d-ae43-6965014cd2cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:25.538251 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74a4af35-d4ac-461d-ae43-6965014cd2cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:25.538696 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74a4af35-d4ac-461d-ae43-6965014cd2cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:25.539119 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74a4af35-d4ac-461d-ae43-6965014cd2cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:25.724010 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-74a4af35-d4ac-461d-ae43-6965014cd2cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:25.732673 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-74a4af35-d4ac-461d-ae43-6965014cd2cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.207720 Sep 15 19:29:25.733311 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 155/316] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:25 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:25.833843 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0641cfe0-3026-4695-941b-828484ce16af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:25.834856 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0641cfe0-3026-4695-941b-828484ce16af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:25.841280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0641cfe0-3026-4695-941b-828484ce16af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:25.841761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0641cfe0-3026-4695-941b-828484ce16af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:25.842192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0641cfe0-3026-4695-941b-828484ce16af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:25.846598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0641cfe0-3026-4695-941b-828484ce16af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:25.846598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0641cfe0-3026-4695-941b-828484ce16af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:25.846598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0641cfe0-3026-4695-941b-828484ce16af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:26.003328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0641cfe0-3026-4695-941b-828484ce16af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:26.016781 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0641cfe0-3026-4695-941b-828484ce16af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.187019 Sep 15 19:29:26.020036 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 162/317] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:25 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:26.376536 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a96985e4-3718-41aa-87b0-88c8c03299cd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:26.377798 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a96985e4-3718-41aa-87b0-88c8c03299cd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:26.386280 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a96985e4-3718-41aa-87b0-88c8c03299cd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:26.386858 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a96985e4-3718-41aa-87b0-88c8c03299cd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:26.387369 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a96985e4-3718-41aa-87b0-88c8c03299cd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:26.388502 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a96985e4-3718-41aa-87b0-88c8c03299cd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:26.388992 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a96985e4-3718-41aa-87b0-88c8c03299cd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:26.389458 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a96985e4-3718-41aa-87b0-88c8c03299cd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:26.409170 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-654016402", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:26.478654 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] validate_networks() for None {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:29:26.593750 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a96985e4-3718-41aa-87b0-88c8c03299cd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:26.599514 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a96985e4-3718-41aa-87b0-88c8c03299cd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.227144 Sep 15 19:29:26.600590 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 156/318] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:26 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:26.608901 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6bc5b77d-900c-4303-9cbc-88ecca9b4cad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:26.608901 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6bc5b77d-900c-4303-9cbc-88ecca9b4cad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:26.617907 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bc5b77d-900c-4303-9cbc-88ecca9b4cad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:26.618810 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bc5b77d-900c-4303-9cbc-88ecca9b4cad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:26.619250 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bc5b77d-900c-4303-9cbc-88ecca9b4cad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:26.620011 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bc5b77d-900c-4303-9cbc-88ecca9b4cad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:26.620465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bc5b77d-900c-4303-9cbc-88ecca9b4cad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:26.623090 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bc5b77d-900c-4303-9cbc-88ecca9b4cad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:26.626376 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:26.799100 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6bc5b77d-900c-4303-9cbc-88ecca9b4cad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:26.808607 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6bc5b77d-900c-4303-9cbc-88ecca9b4cad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.206664 Sep 15 19:29:26.809434 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 157/319] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:26 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:26.814758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1b90f61-eadd-483a-a6af-5ad794fdefea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:26.815573 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c1b90f61-eadd-483a-a6af-5ad794fdefea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:26.818467 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:29:26.819169 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:29:26.819857 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:29:26.820426 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:29:26.821022 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:29:26.823013 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b90f61-eadd-483a-a6af-5ad794fdefea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:26.823679 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b90f61-eadd-483a-a6af-5ad794fdefea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:26.824716 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b90f61-eadd-483a-a6af-5ad794fdefea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:26.825601 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b90f61-eadd-483a-a6af-5ad794fdefea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:26.826247 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b90f61-eadd-483a-a6af-5ad794fdefea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:26.826672 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b90f61-eadd-483a-a6af-5ad794fdefea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:26.834758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:26.835275 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:26.838848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:26.838848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:26.838848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:26.838848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:26.858236 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Getting quotas for project ac8e5530469c44cd8c4d962899f6ac5b. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:29:26.862839 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Getting quotas for user 7aa5ec5bad5e41fcbdfd155bdcf6fd8a and project ac8e5530469c44cd8c4d962899f6ac5b. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:29:26.876022 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:29:26.878370 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:29:26.981228 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1b90f61-eadd-483a-a6af-5ad794fdefea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:26.991122 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c1b90f61-eadd-483a-a6af-5ad794fdefea tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.179767 Sep 15 19:29:27.007230 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 158/320] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:26 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:27.016109 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-62dc1de6-8f36-4d7b-842b-c937e937cf80 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610952 Sep 15 19:29:27.016780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 163/321] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:29:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 19:29:27.033547 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-00408cf9-fd47-406b-902a-84b2ae65b59a tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:27.034181 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-00408cf9-fd47-406b-902a-84b2ae65b59a tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:27.049364 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-57d5e6e1-d0b3-42c3-bc5e-bbe7a2af1820 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:27.050285 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-57d5e6e1-d0b3-42c3-bc5e-bbe7a2af1820 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:27.060180 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57d5e6e1-d0b3-42c3-bc5e-bbe7a2af1820 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:27.061318 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57d5e6e1-d0b3-42c3-bc5e-bbe7a2af1820 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:27.062015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57d5e6e1-d0b3-42c3-bc5e-bbe7a2af1820 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:27.063314 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57d5e6e1-d0b3-42c3-bc5e-bbe7a2af1820 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:27.069395 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57d5e6e1-d0b3-42c3-bc5e-bbe7a2af1820 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:27.069395 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57d5e6e1-d0b3-42c3-bc5e-bbe7a2af1820 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:27.094172 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-00408cf9-fd47-406b-902a-84b2ae65b59a tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:27.103082 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-00408cf9-fd47-406b-902a-84b2ae65b59a tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1214 microversion: 2.1 time: 0.073325 Sep 15 19:29:27.113794 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 159/322] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:27 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:27.234196 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-57d5e6e1-d0b3-42c3-bc5e-bbe7a2af1820 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:27.244781 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-57d5e6e1-d0b3-42c3-bc5e-bbe7a2af1820 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.203195 Sep 15 19:29:27.259763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 164/323] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:27 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:27.624764 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea2f51a9-c2d5-4e68-8c29-f0747ab24ee5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:27.633754 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ea2f51a9-c2d5-4e68-8c29-f0747ab24ee5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:27.633754 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea2f51a9-c2d5-4e68-8c29-f0747ab24ee5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:27.633754 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea2f51a9-c2d5-4e68-8c29-f0747ab24ee5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:27.633754 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea2f51a9-c2d5-4e68-8c29-f0747ab24ee5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:27.634194 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea2f51a9-c2d5-4e68-8c29-f0747ab24ee5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:27.634627 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea2f51a9-c2d5-4e68-8c29-f0747ab24ee5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:27.635058 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea2f51a9-c2d5-4e68-8c29-f0747ab24ee5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:27.780299 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ea2f51a9-c2d5-4e68-8c29-f0747ab24ee5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:27.791240 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ea2f51a9-c2d5-4e68-8c29-f0747ab24ee5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.169870 Sep 15 19:29:27.792249 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 160/324] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:27 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:27.833893 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b0135fcb-e489-4e25-89b1-ef120c5ffe52 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:27.835186 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b0135fcb-e489-4e25-89b1-ef120c5ffe52 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:27.842054 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0135fcb-e489-4e25-89b1-ef120c5ffe52 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:27.842570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0135fcb-e489-4e25-89b1-ef120c5ffe52 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:27.843015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0135fcb-e489-4e25-89b1-ef120c5ffe52 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:27.843767 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0135fcb-e489-4e25-89b1-ef120c5ffe52 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:27.844431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0135fcb-e489-4e25-89b1-ef120c5ffe52 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:27.845352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0135fcb-e489-4e25-89b1-ef120c5ffe52 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:27.996765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b0135fcb-e489-4e25-89b1-ef120c5ffe52 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:28.004702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b0135fcb-e489-4e25-89b1-ef120c5ffe52 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.174758 Sep 15 19:29:28.005280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 165/325] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:27 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:28.018662 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0f546f16-bb52-4052-9aa8-4f4c2419815d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:28.019306 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0f546f16-bb52-4052-9aa8-4f4c2419815d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:28.025577 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f546f16-bb52-4052-9aa8-4f4c2419815d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:28.026065 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f546f16-bb52-4052-9aa8-4f4c2419815d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:28.026503 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f546f16-bb52-4052-9aa8-4f4c2419815d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:28.027195 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f546f16-bb52-4052-9aa8-4f4c2419815d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:28.027697 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f546f16-bb52-4052-9aa8-4f4c2419815d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:28.028123 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f546f16-bb52-4052-9aa8-4f4c2419815d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:28.129691 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c2edda90-c5f1-44c8-9036-a612c270f90c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:28.130553 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c2edda90-c5f1-44c8-9036-a612c270f90c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:28.183995 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0f546f16-bb52-4052-9aa8-4f4c2419815d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:28.194418 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0f546f16-bb52-4052-9aa8-4f4c2419815d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.178375 Sep 15 19:29:28.194418 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 161/326] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:28 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:28.213354 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c2edda90-c5f1-44c8-9036-a612c270f90c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:28.220571 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c2edda90-c5f1-44c8-9036-a612c270f90c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1214 microversion: 2.1 time: 0.095195 Sep 15 19:29:28.223126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 166/327] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:28 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:28.270308 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2cadb61c-7696-4e20-bec7-f03a8dc5c758 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:28.274663 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2cadb61c-7696-4e20-bec7-f03a8dc5c758 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:28.276970 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cadb61c-7696-4e20-bec7-f03a8dc5c758 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:28.277469 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cadb61c-7696-4e20-bec7-f03a8dc5c758 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:28.277909 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cadb61c-7696-4e20-bec7-f03a8dc5c758 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:28.278609 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cadb61c-7696-4e20-bec7-f03a8dc5c758 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:28.279057 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cadb61c-7696-4e20-bec7-f03a8dc5c758 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:28.279487 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cadb61c-7696-4e20-bec7-f03a8dc5c758 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:28.438033 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2cadb61c-7696-4e20-bec7-f03a8dc5c758 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:28.446107 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2cadb61c-7696-4e20-bec7-f03a8dc5c758 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.179943 Sep 15 19:29:28.446638 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 162/328] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:28 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:28.818411 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7ca57e75-7d0d-44fe-a78f-fb0ef1b96510 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:28.819057 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7ca57e75-7d0d-44fe-a78f-fb0ef1b96510 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:28.825205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ca57e75-7d0d-44fe-a78f-fb0ef1b96510 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:28.825693 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ca57e75-7d0d-44fe-a78f-fb0ef1b96510 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:28.826134 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ca57e75-7d0d-44fe-a78f-fb0ef1b96510 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:28.826832 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ca57e75-7d0d-44fe-a78f-fb0ef1b96510 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:28.827292 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ca57e75-7d0d-44fe-a78f-fb0ef1b96510 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:28.827749 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ca57e75-7d0d-44fe-a78f-fb0ef1b96510 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:28.994037 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7ca57e75-7d0d-44fe-a78f-fb0ef1b96510 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:29.002190 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7ca57e75-7d0d-44fe-a78f-fb0ef1b96510 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.187659 Sep 15 19:29:29.002758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 167/329] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:28 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:29.028468 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-29e1a12f-ca1f-42bb-b401-c2f429478639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:29.029077 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-29e1a12f-ca1f-42bb-b401-c2f429478639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:29.035428 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29e1a12f-ca1f-42bb-b401-c2f429478639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:29.040518 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29e1a12f-ca1f-42bb-b401-c2f429478639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:29.040518 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29e1a12f-ca1f-42bb-b401-c2f429478639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:29.040518 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29e1a12f-ca1f-42bb-b401-c2f429478639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:29.040518 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29e1a12f-ca1f-42bb-b401-c2f429478639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:29.040984 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29e1a12f-ca1f-42bb-b401-c2f429478639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:29.167216 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-29e1a12f-ca1f-42bb-b401-c2f429478639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:29.175219 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-29e1a12f-ca1f-42bb-b401-c2f429478639 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.150559 Sep 15 19:29:29.175818 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 163/330] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:29 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:29.216357 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e8835ed9-b328-43a4-89b7-27b594976428 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:29.216978 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e8835ed9-b328-43a4-89b7-27b594976428 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:29.222944 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8835ed9-b328-43a4-89b7-27b594976428 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:29.223436 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8835ed9-b328-43a4-89b7-27b594976428 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:29.223913 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8835ed9-b328-43a4-89b7-27b594976428 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:29.224607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8835ed9-b328-43a4-89b7-27b594976428 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:29.225063 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8835ed9-b328-43a4-89b7-27b594976428 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:29.225488 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8835ed9-b328-43a4-89b7-27b594976428 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:29.245783 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-91c620cc-7bb9-498e-970b-1d187d7b27aa tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:29.246327 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-91c620cc-7bb9-498e-970b-1d187d7b27aa tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:29.252196 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91c620cc-7bb9-498e-970b-1d187d7b27aa tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:29.252686 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91c620cc-7bb9-498e-970b-1d187d7b27aa tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:29.253125 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91c620cc-7bb9-498e-970b-1d187d7b27aa tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:29.253852 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91c620cc-7bb9-498e-970b-1d187d7b27aa tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:29.254304 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91c620cc-7bb9-498e-970b-1d187d7b27aa tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:29.254731 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91c620cc-7bb9-498e-970b-1d187d7b27aa tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:29.317800 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-91c620cc-7bb9-498e-970b-1d187d7b27aa tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:29.336540 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-91c620cc-7bb9-498e-970b-1d187d7b27aa tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1218 microversion: 2.1 time: 0.093554 Sep 15 19:29:29.351672 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 164/331] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:29 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:29.421213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e8835ed9-b328-43a4-89b7-27b594976428 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:29.430433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e8835ed9-b328-43a4-89b7-27b594976428 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.217598 Sep 15 19:29:29.431019 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 168/332] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:29 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:29.469379 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd7ffcae-27a8-4dab-baf3-ce32735f6f1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:29.470001 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fd7ffcae-27a8-4dab-baf3-ce32735f6f1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:29.477598 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd7ffcae-27a8-4dab-baf3-ce32735f6f1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:29.480683 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd7ffcae-27a8-4dab-baf3-ce32735f6f1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:29.480683 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd7ffcae-27a8-4dab-baf3-ce32735f6f1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:29.480683 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd7ffcae-27a8-4dab-baf3-ce32735f6f1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:29.480683 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd7ffcae-27a8-4dab-baf3-ce32735f6f1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:29.481037 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd7ffcae-27a8-4dab-baf3-ce32735f6f1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:29.652868 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fd7ffcae-27a8-4dab-baf3-ce32735f6f1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:29.660754 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd7ffcae-27a8-4dab-baf3-ce32735f6f1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1313 microversion: 2.1 time: 0.195359 Sep 15 19:29:29.661332 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 165/333] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:29 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:30.025884 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bb7e38f0-9f29-49dd-8a12-4a27026d05f7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:30.026543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bb7e38f0-9f29-49dd-8a12-4a27026d05f7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:30.033053 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bb7e38f0-9f29-49dd-8a12-4a27026d05f7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:30.033534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bb7e38f0-9f29-49dd-8a12-4a27026d05f7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:30.033971 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bb7e38f0-9f29-49dd-8a12-4a27026d05f7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:30.034668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bb7e38f0-9f29-49dd-8a12-4a27026d05f7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:30.035149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bb7e38f0-9f29-49dd-8a12-4a27026d05f7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:30.035571 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bb7e38f0-9f29-49dd-8a12-4a27026d05f7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:30.198376 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5b94fda4-3a43-4362-9eca-5023898522ff tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:30.199816 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5b94fda4-3a43-4362-9eca-5023898522ff tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:30.206161 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b94fda4-3a43-4362-9eca-5023898522ff tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:30.206642 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b94fda4-3a43-4362-9eca-5023898522ff tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:30.207334 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b94fda4-3a43-4362-9eca-5023898522ff tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:30.208298 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b94fda4-3a43-4362-9eca-5023898522ff tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:30.208967 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b94fda4-3a43-4362-9eca-5023898522ff tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:30.210131 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b94fda4-3a43-4362-9eca-5023898522ff tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:30.226610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bb7e38f0-9f29-49dd-8a12-4a27026d05f7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:30.238326 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bb7e38f0-9f29-49dd-8a12-4a27026d05f7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.216138 Sep 15 19:29:30.253000 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 169/334] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:30 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:30.361881 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4dda48fa-b15a-4bb8-8cb4-0897e662a9eb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:30.365705 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4dda48fa-b15a-4bb8-8cb4-0897e662a9eb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:30.368954 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4dda48fa-b15a-4bb8-8cb4-0897e662a9eb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:30.369524 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4dda48fa-b15a-4bb8-8cb4-0897e662a9eb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:30.369962 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4dda48fa-b15a-4bb8-8cb4-0897e662a9eb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:30.371076 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4dda48fa-b15a-4bb8-8cb4-0897e662a9eb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:30.372128 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4dda48fa-b15a-4bb8-8cb4-0897e662a9eb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:30.372896 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4dda48fa-b15a-4bb8-8cb4-0897e662a9eb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:30.439593 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5b94fda4-3a43-4362-9eca-5023898522ff tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:30.447557 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5b94fda4-3a43-4362-9eca-5023898522ff tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.252981 Sep 15 19:29:30.449472 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 166/335] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:30 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:30.452152 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4dda48fa-b15a-4bb8-8cb4-0897e662a9eb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:30.455079 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3c2984fe-9307-4902-8b5b-bcdc3d6cc381 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:30.455714 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3c2984fe-9307-4902-8b5b-bcdc3d6cc381 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:30.460613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4dda48fa-b15a-4bb8-8cb4-0897e662a9eb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1210 microversion: 2.1 time: 0.102829 Sep 15 19:29:30.461192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 170/336] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:30 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:30.462943 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c2984fe-9307-4902-8b5b-bcdc3d6cc381 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:30.463424 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c2984fe-9307-4902-8b5b-bcdc3d6cc381 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:30.463983 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c2984fe-9307-4902-8b5b-bcdc3d6cc381 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:30.464679 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c2984fe-9307-4902-8b5b-bcdc3d6cc381 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:30.465239 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c2984fe-9307-4902-8b5b-bcdc3d6cc381 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:30.465579 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c2984fe-9307-4902-8b5b-bcdc3d6cc381 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:30.612311 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3c2984fe-9307-4902-8b5b-bcdc3d6cc381 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:30.620103 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3c2984fe-9307-4902-8b5b-bcdc3d6cc381 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.168587 Sep 15 19:29:30.620661 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 167/337] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:30 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:30.692632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f3bfe08a-7f2b-4108-880d-d55bcc9a931b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:30.693178 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f3bfe08a-7f2b-4108-880d-d55bcc9a931b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:30.699876 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3bfe08a-7f2b-4108-880d-d55bcc9a931b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:30.700362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3bfe08a-7f2b-4108-880d-d55bcc9a931b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:30.700796 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3bfe08a-7f2b-4108-880d-d55bcc9a931b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:30.701518 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3bfe08a-7f2b-4108-880d-d55bcc9a931b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:30.701947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3bfe08a-7f2b-4108-880d-d55bcc9a931b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:30.702375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3bfe08a-7f2b-4108-880d-d55bcc9a931b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:31.079427 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f3bfe08a-7f2b-4108-880d-d55bcc9a931b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:31.087504 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f3bfe08a-7f2b-4108-880d-d55bcc9a931b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1497 microversion: 2.1 time: 0.398908 Sep 15 19:29:31.088380 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 171/338] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:30 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1497 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:31.263344 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc54cab9-8f82-4392-a776-8905a60371e5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:31.263977 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bc54cab9-8f82-4392-a776-8905a60371e5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:31.270498 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc54cab9-8f82-4392-a776-8905a60371e5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:31.270973 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc54cab9-8f82-4392-a776-8905a60371e5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:31.271404 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc54cab9-8f82-4392-a776-8905a60371e5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:31.272185 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc54cab9-8f82-4392-a776-8905a60371e5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:31.272657 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc54cab9-8f82-4392-a776-8905a60371e5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:31.273264 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc54cab9-8f82-4392-a776-8905a60371e5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:31.387466 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d9a897e2-2bb4-4c19-8e99-150385639719 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:31.392129 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d9a897e2-2bb4-4c19-8e99-150385639719 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:31.393864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9a897e2-2bb4-4c19-8e99-150385639719 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:31.394351 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9a897e2-2bb4-4c19-8e99-150385639719 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:31.394792 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9a897e2-2bb4-4c19-8e99-150385639719 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:31.395491 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9a897e2-2bb4-4c19-8e99-150385639719 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:31.395977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9a897e2-2bb4-4c19-8e99-150385639719 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:31.396393 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9a897e2-2bb4-4c19-8e99-150385639719 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:31.405534 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc54cab9-8f82-4392-a776-8905a60371e5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:31.414216 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc54cab9-8f82-4392-a776-8905a60371e5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.154819 Sep 15 19:29:31.414869 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 168/339] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:31 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:31.420845 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d9a897e2-2bb4-4c19-8e99-150385639719 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/ips" status: 200 len: 146 microversion: 2.1 time: 0.037494 Sep 15 19:29:31.421416 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 172/340] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 15 19:29:31 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:29:31.471037 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a188cc2-026d-40b3-9506-c946fe6b9b9a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:31.471664 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a188cc2-026d-40b3-9506-c946fe6b9b9a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:31.478448 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a188cc2-026d-40b3-9506-c946fe6b9b9a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:31.482210 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a188cc2-026d-40b3-9506-c946fe6b9b9a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:31.482210 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a188cc2-026d-40b3-9506-c946fe6b9b9a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:31.482210 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a188cc2-026d-40b3-9506-c946fe6b9b9a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:31.482210 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a188cc2-026d-40b3-9506-c946fe6b9b9a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:31.482618 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a188cc2-026d-40b3-9506-c946fe6b9b9a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:31.484160 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-21724afd-3778-4640-a282-f2dbc22bf08b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:31.484780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-21724afd-3778-4640-a282-f2dbc22bf08b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:31.491526 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-21724afd-3778-4640-a282-f2dbc22bf08b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:31.492112 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-21724afd-3778-4640-a282-f2dbc22bf08b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:31.492555 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-21724afd-3778-4640-a282-f2dbc22bf08b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:31.493268 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-21724afd-3778-4640-a282-f2dbc22bf08b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:31.493720 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-21724afd-3778-4640-a282-f2dbc22bf08b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:31.494145 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-21724afd-3778-4640-a282-f2dbc22bf08b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:31.559895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-21724afd-3778-4640-a282-f2dbc22bf08b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:31.567945 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-21724afd-3778-4640-a282-f2dbc22bf08b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1266 microversion: 2.1 time: 0.087871 Sep 15 19:29:31.568551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 173/341] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:31 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:31.620459 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a188cc2-026d-40b3-9506-c946fe6b9b9a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:31.627419 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a188cc2-026d-40b3-9506-c946fe6b9b9a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.160238 Sep 15 19:29:31.628603 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 169/342] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:31 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:31.644430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-80d056f7-9613-441a-815b-25d3848a72a8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:31.650340 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-80d056f7-9613-441a-815b-25d3848a72a8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:31.652154 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80d056f7-9613-441a-815b-25d3848a72a8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:31.652651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80d056f7-9613-441a-815b-25d3848a72a8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:31.653469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80d056f7-9613-441a-815b-25d3848a72a8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:31.654266 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80d056f7-9613-441a-815b-25d3848a72a8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:31.654727 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80d056f7-9613-441a-815b-25d3848a72a8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:31.655155 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80d056f7-9613-441a-815b-25d3848a72a8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:31.790592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-80d056f7-9613-441a-815b-25d3848a72a8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:31.798248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-80d056f7-9613-441a-815b-25d3848a72a8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.158438 Sep 15 19:29:31.798817 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 174/343] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:31 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:32.043904 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-34e81959-b829-4477-aeed-509ed7ff7ca2 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:32.052105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-34e81959-b829-4477-aeed-509ed7ff7ca2 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:32.052105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34e81959-b829-4477-aeed-509ed7ff7ca2 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:32.052105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34e81959-b829-4477-aeed-509ed7ff7ca2 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:32.052105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34e81959-b829-4477-aeed-509ed7ff7ca2 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:32.052483 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34e81959-b829-4477-aeed-509ed7ff7ca2 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:32.052587 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34e81959-b829-4477-aeed-509ed7ff7ca2 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:32.052993 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34e81959-b829-4477-aeed-509ed7ff7ca2 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:32.078441 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-34e81959-b829-4477-aeed-509ed7ff7ca2 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:29:32.395557 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-34e81959-b829-4477-aeed-509ed7ff7ca2 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 204 len: 0 microversion: 2.1 time: 0.355302 Sep 15 19:29:32.396280 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 170/344] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:29:32 2022] DELETE /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 19:29:32.404335 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b5c23fc8-fe11-4a2f-9997-7c9c6ac63bdf tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:32.404950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b5c23fc8-fe11-4a2f-9997-7c9c6ac63bdf tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:32.411378 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5c23fc8-fe11-4a2f-9997-7c9c6ac63bdf tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:32.415015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5c23fc8-fe11-4a2f-9997-7c9c6ac63bdf tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:32.415015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5c23fc8-fe11-4a2f-9997-7c9c6ac63bdf tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:32.415015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5c23fc8-fe11-4a2f-9997-7c9c6ac63bdf tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:32.415015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5c23fc8-fe11-4a2f-9997-7c9c6ac63bdf tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:32.415387 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5c23fc8-fe11-4a2f-9997-7c9c6ac63bdf tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:32.438442 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d290decf-ec24-4377-a98b-2c54a54142c7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:32.439439 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d290decf-ec24-4377-a98b-2c54a54142c7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:32.446136 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d290decf-ec24-4377-a98b-2c54a54142c7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:32.449443 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d290decf-ec24-4377-a98b-2c54a54142c7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:32.449443 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d290decf-ec24-4377-a98b-2c54a54142c7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:32.449443 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d290decf-ec24-4377-a98b-2c54a54142c7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:32.449443 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d290decf-ec24-4377-a98b-2c54a54142c7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:32.449851 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d290decf-ec24-4377-a98b-2c54a54142c7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:32.548206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b5c23fc8-fe11-4a2f-9997-7c9c6ac63bdf tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:32.557188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b5c23fc8-fe11-4a2f-9997-7c9c6ac63bdf tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1503 microversion: 2.1 time: 0.156657 Sep 15 19:29:32.560199 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 175/345] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:32 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:32.584411 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d290decf-ec24-4377-a98b-2c54a54142c7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:32.590438 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1c4d2ea5-3c48-4910-b00f-d6797f61d6b5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:32.591082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1c4d2ea5-3c48-4910-b00f-d6797f61d6b5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:32.592419 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d290decf-ec24-4377-a98b-2c54a54142c7 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.158237 Sep 15 19:29:32.592993 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 171/346] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:32 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:32.597379 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c4d2ea5-3c48-4910-b00f-d6797f61d6b5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:32.597865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c4d2ea5-3c48-4910-b00f-d6797f61d6b5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:32.598300 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c4d2ea5-3c48-4910-b00f-d6797f61d6b5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:32.598993 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c4d2ea5-3c48-4910-b00f-d6797f61d6b5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:32.599443 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c4d2ea5-3c48-4910-b00f-d6797f61d6b5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:32.599981 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c4d2ea5-3c48-4910-b00f-d6797f61d6b5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:32.604358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:32.650525 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9e386c0d-78fd-43cc-933b-847e6c5d414a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:32.651144 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9e386c0d-78fd-43cc-933b-847e6c5d414a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:32.657130 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e386c0d-78fd-43cc-933b-847e6c5d414a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:32.657619 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e386c0d-78fd-43cc-933b-847e6c5d414a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:32.658064 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e386c0d-78fd-43cc-933b-847e6c5d414a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:32.658763 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e386c0d-78fd-43cc-933b-847e6c5d414a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:32.659219 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e386c0d-78fd-43cc-933b-847e6c5d414a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:32.660193 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e386c0d-78fd-43cc-933b-847e6c5d414a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:32.662475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1c4d2ea5-3c48-4910-b00f-d6797f61d6b5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:32.670262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1c4d2ea5-3c48-4910-b00f-d6797f61d6b5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1266 microversion: 2.1 time: 0.083827 Sep 15 19:29:32.670828 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 176/347] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:32 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:32.795562 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9e386c0d-78fd-43cc-933b-847e6c5d414a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:32.804317 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9e386c0d-78fd-43cc-933b-847e6c5d414a tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.157636 Sep 15 19:29:32.806566 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 172/348] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:32 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:32.821532 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-783a513c-974e-4324-a783-89bce9811e1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:32.822138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-783a513c-974e-4324-a783-89bce9811e1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:32.829283 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-783a513c-974e-4324-a783-89bce9811e1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:32.829770 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-783a513c-974e-4324-a783-89bce9811e1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:32.830195 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-783a513c-974e-4324-a783-89bce9811e1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:32.830893 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-783a513c-974e-4324-a783-89bce9811e1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:32.831346 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-783a513c-974e-4324-a783-89bce9811e1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:32.831768 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-783a513c-974e-4324-a783-89bce9811e1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:32.978636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-783a513c-974e-4324-a783-89bce9811e1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:32.987219 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-783a513c-974e-4324-a783-89bce9811e1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1368 microversion: 2.1 time: 0.169839 Sep 15 19:29:32.987819 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 177/349] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:32 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:33.585919 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-886e333e-eae8-4201-b0d3-bd4a9b24dd18 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:33.586535 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-886e333e-eae8-4201-b0d3-bd4a9b24dd18 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:33.593567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-886e333e-eae8-4201-b0d3-bd4a9b24dd18 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:33.594133 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-886e333e-eae8-4201-b0d3-bd4a9b24dd18 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:33.594642 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-886e333e-eae8-4201-b0d3-bd4a9b24dd18 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:33.595420 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-886e333e-eae8-4201-b0d3-bd4a9b24dd18 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:33.595973 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-886e333e-eae8-4201-b0d3-bd4a9b24dd18 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:33.596595 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-886e333e-eae8-4201-b0d3-bd4a9b24dd18 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:33.616352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8077909a-cf28-414a-9665-b6cff11b7047 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:33.616932 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:33.617072 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8077909a-cf28-414a-9665-b6cff11b7047 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:33.624486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8077909a-cf28-414a-9665-b6cff11b7047 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:33.625031 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8077909a-cf28-414a-9665-b6cff11b7047 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:33.625535 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8077909a-cf28-414a-9665-b6cff11b7047 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:33.626683 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8077909a-cf28-414a-9665-b6cff11b7047 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:33.627219 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8077909a-cf28-414a-9665-b6cff11b7047 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:33.627905 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8077909a-cf28-414a-9665-b6cff11b7047 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:33.805441 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8077909a-cf28-414a-9665-b6cff11b7047 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:33.813578 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8077909a-cf28-414a-9665-b6cff11b7047 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.202572 Sep 15 19:29:33.814258 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 178/350] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:33 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:33.820557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4c75f9df-7148-4ed6-968d-8f3f90f25524 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:33.821478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4c75f9df-7148-4ed6-968d-8f3f90f25524 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:33.828144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c75f9df-7148-4ed6-968d-8f3f90f25524 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:33.828986 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c75f9df-7148-4ed6-968d-8f3f90f25524 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:33.829667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c75f9df-7148-4ed6-968d-8f3f90f25524 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:33.830607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c75f9df-7148-4ed6-968d-8f3f90f25524 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:33.831281 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c75f9df-7148-4ed6-968d-8f3f90f25524 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:33.831992 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c75f9df-7148-4ed6-968d-8f3f90f25524 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:33.857250 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-886e333e-eae8-4201-b0d3-bd4a9b24dd18 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:33.866453 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-886e333e-eae8-4201-b0d3-bd4a9b24dd18 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1503 microversion: 2.1 time: 0.284880 Sep 15 19:29:33.867848 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 173/351] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:33 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1503 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:33.876550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-facb310b-ffde-41bc-9080-6b46e2ddde25 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:33.877853 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-facb310b-ffde-41bc-9080-6b46e2ddde25 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:33.885801 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-facb310b-ffde-41bc-9080-6b46e2ddde25 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:33.886645 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-facb310b-ffde-41bc-9080-6b46e2ddde25 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:33.887291 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-facb310b-ffde-41bc-9080-6b46e2ddde25 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:33.889097 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-facb310b-ffde-41bc-9080-6b46e2ddde25 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:33.889900 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-facb310b-ffde-41bc-9080-6b46e2ddde25 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:33.890744 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-facb310b-ffde-41bc-9080-6b46e2ddde25 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:33.940953 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4c75f9df-7148-4ed6-968d-8f3f90f25524 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:33.949716 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4c75f9df-7148-4ed6-968d-8f3f90f25524 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1266 microversion: 2.1 time: 0.134181 Sep 15 19:29:33.950739 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 179/352] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:33 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:34.018299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5541f99e-f273-40ec-becd-7826c77a6688 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:34.018985 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5541f99e-f273-40ec-becd-7826c77a6688 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:34.027986 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5541f99e-f273-40ec-becd-7826c77a6688 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:34.029166 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5541f99e-f273-40ec-becd-7826c77a6688 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:34.029631 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5541f99e-f273-40ec-becd-7826c77a6688 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:34.030886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5541f99e-f273-40ec-becd-7826c77a6688 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:34.031355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5541f99e-f273-40ec-becd-7826c77a6688 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:34.031821 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5541f99e-f273-40ec-becd-7826c77a6688 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:34.036392 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-facb310b-ffde-41bc-9080-6b46e2ddde25 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:34.044409 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-facb310b-ffde-41bc-9080-6b46e2ddde25 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.175743 Sep 15 19:29:34.044971 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 174/353] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:33 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:34.185560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5541f99e-f273-40ec-becd-7826c77a6688 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:34.193346 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5541f99e-f273-40ec-becd-7826c77a6688 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1557 microversion: 2.1 time: 0.180695 Sep 15 19:29:34.194514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 180/354] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:34 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1557 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:34.217857 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-382e5668-3cc6-4a61-ae7a-9d12d72baa74 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:34.219818 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-382e5668-3cc6-4a61-ae7a-9d12d72baa74 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:34.225717 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-382e5668-3cc6-4a61-ae7a-9d12d72baa74 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:34.226219 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-382e5668-3cc6-4a61-ae7a-9d12d72baa74 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:34.226651 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-382e5668-3cc6-4a61-ae7a-9d12d72baa74 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:34.227345 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-382e5668-3cc6-4a61-ae7a-9d12d72baa74 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:34.227831 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-382e5668-3cc6-4a61-ae7a-9d12d72baa74 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:34.228315 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-382e5668-3cc6-4a61-ae7a-9d12d72baa74 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:34.314424 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-382e5668-3cc6-4a61-ae7a-9d12d72baa74 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100613 Sep 15 19:29:34.315209 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 175/355] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 15 19:29:34 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:34.841196 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a7a83644-ae33-4e92-aeed-2844a7481a2f tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:34.841855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a7a83644-ae33-4e92-aeed-2844a7481a2f tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:34.848992 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a7a83644-ae33-4e92-aeed-2844a7481a2f tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:34.849482 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a7a83644-ae33-4e92-aeed-2844a7481a2f tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:34.850497 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a7a83644-ae33-4e92-aeed-2844a7481a2f tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:34.851221 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a7a83644-ae33-4e92-aeed-2844a7481a2f tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:34.851707 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a7a83644-ae33-4e92-aeed-2844a7481a2f tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:34.852137 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a7a83644-ae33-4e92-aeed-2844a7481a2f tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:34.891221 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-39b8c21b-7eca-4bc3-afff-144276f8ecfc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:34.891872 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-39b8c21b-7eca-4bc3-afff-144276f8ecfc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:34.899400 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b8c21b-7eca-4bc3-afff-144276f8ecfc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:34.905170 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b8c21b-7eca-4bc3-afff-144276f8ecfc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:34.905170 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b8c21b-7eca-4bc3-afff-144276f8ecfc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:34.905170 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b8c21b-7eca-4bc3-afff-144276f8ecfc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:34.905170 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b8c21b-7eca-4bc3-afff-144276f8ecfc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:34.905796 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b8c21b-7eca-4bc3-afff-144276f8ecfc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:35.006633 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a7a83644-ae33-4e92-aeed-2844a7481a2f tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:35.015229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a7a83644-ae33-4e92-aeed-2844a7481a2f tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.177936 Sep 15 19:29:35.015855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 181/356] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:34 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:35.023690 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4112a4e3-a25c-4734-bfc5-ee401f546cc3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:35.024580 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4112a4e3-a25c-4734-bfc5-ee401f546cc3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:35.030843 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4112a4e3-a25c-4734-bfc5-ee401f546cc3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:35.031528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4112a4e3-a25c-4734-bfc5-ee401f546cc3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:35.032155 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4112a4e3-a25c-4734-bfc5-ee401f546cc3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:35.033187 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4112a4e3-a25c-4734-bfc5-ee401f546cc3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:35.033636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4112a4e3-a25c-4734-bfc5-ee401f546cc3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:35.034246 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4112a4e3-a25c-4734-bfc5-ee401f546cc3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:35.107187 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4112a4e3-a25c-4734-bfc5-ee401f546cc3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:35.115848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4112a4e3-a25c-4734-bfc5-ee401f546cc3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1266 microversion: 2.1 time: 0.098758 Sep 15 19:29:35.116533 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 182/357] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:35 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:35.121176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-36ad1a96-5ecd-454a-920c-0f422fe2e64f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:35.122418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-36ad1a96-5ecd-454a-920c-0f422fe2e64f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:35.133297 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-36ad1a96-5ecd-454a-920c-0f422fe2e64f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:35.133297 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-36ad1a96-5ecd-454a-920c-0f422fe2e64f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:35.133875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-36ad1a96-5ecd-454a-920c-0f422fe2e64f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:35.134357 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-36ad1a96-5ecd-454a-920c-0f422fe2e64f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:35.134800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-36ad1a96-5ecd-454a-920c-0f422fe2e64f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:35.135218 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-36ad1a96-5ecd-454a-920c-0f422fe2e64f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:35.290320 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-39b8c21b-7eca-4bc3-afff-144276f8ecfc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:35.305554 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-36ad1a96-5ecd-454a-920c-0f422fe2e64f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:35.307277 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-39b8c21b-7eca-4bc3-afff-144276f8ecfc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1503 microversion: 2.1 time: 0.420693 Sep 15 19:29:35.322947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-36ad1a96-5ecd-454a-920c-0f422fe2e64f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.199254 Sep 15 19:29:35.322947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 183/358] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:35 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:35.323622 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 176/359] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:34 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1503 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:35.419925 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-262381a6-af47-4b54-a42f-aaaeecac2b1b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e64f525f-20ca-44ae-817c-bc94e954b245"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:35.422642 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-262381a6-af47-4b54-a42f-aaaeecac2b1b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:35.430679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-262381a6-af47-4b54-a42f-aaaeecac2b1b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:35.430679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-262381a6-af47-4b54-a42f-aaaeecac2b1b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:35.434820 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-262381a6-af47-4b54-a42f-aaaeecac2b1b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:35.434820 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-262381a6-af47-4b54-a42f-aaaeecac2b1b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:35.434820 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-262381a6-af47-4b54-a42f-aaaeecac2b1b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:35.434820 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-262381a6-af47-4b54-a42f-aaaeecac2b1b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:36.041552 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-82f042bb-0a1b-4a16-bf71-2656dfe2d04b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:36.042886 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-82f042bb-0a1b-4a16-bf71-2656dfe2d04b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:36.058971 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82f042bb-0a1b-4a16-bf71-2656dfe2d04b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:36.071663 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82f042bb-0a1b-4a16-bf71-2656dfe2d04b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:36.072396 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82f042bb-0a1b-4a16-bf71-2656dfe2d04b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:36.073238 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82f042bb-0a1b-4a16-bf71-2656dfe2d04b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:36.073809 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82f042bb-0a1b-4a16-bf71-2656dfe2d04b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:36.074315 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82f042bb-0a1b-4a16-bf71-2656dfe2d04b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:36.284837 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-82f042bb-0a1b-4a16-bf71-2656dfe2d04b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:36.292828 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-82f042bb-0a1b-4a16-bf71-2656dfe2d04b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.255478 Sep 15 19:29:36.293392 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 177/360] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:36 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:36.307848 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-562c8666-555c-43c6-acb0-f9c117a27201 req-4ccdee3c-d5af-46b7-8d1f-0381400c1c5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6cfa71-df2d-4e56-ba89-35f6153f327f", "tag": "f848c54c-bc13-4277-851b-f4482d166911"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:36.311578 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-562c8666-555c-43c6-acb0-f9c117a27201 req-4ccdee3c-d5af-46b7-8d1f-0381400c1c5f service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:36.312105 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-562c8666-555c-43c6-acb0-f9c117a27201 req-4ccdee3c-d5af-46b7-8d1f-0381400c1c5f service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:36.312544 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-562c8666-555c-43c6-acb0-f9c117a27201 req-4ccdee3c-d5af-46b7-8d1f-0381400c1c5f service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:36.331453 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-562c8666-555c-43c6-acb0-f9c117a27201 req-4ccdee3c-d5af-46b7-8d1f-0381400c1c5f service nova] Creating event network-changed:f848c54c-bc13-4277-851b-f4482d166911 for instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f on hv-cinder-84984 Sep 15 19:29:36.340651 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-562c8666-555c-43c6-acb0-f9c117a27201 req-4ccdee3c-d5af-46b7-8d1f-0381400c1c5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043494 Sep 15 19:29:36.342126 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 178/361] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:36.349558 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab4674d0-310e-4a59-b61e-484005c613f8 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:36.352879 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ab4674d0-310e-4a59-b61e-484005c613f8 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:36.356567 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab4674d0-310e-4a59-b61e-484005c613f8 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:36.357057 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab4674d0-310e-4a59-b61e-484005c613f8 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:36.357499 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab4674d0-310e-4a59-b61e-484005c613f8 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:36.358302 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab4674d0-310e-4a59-b61e-484005c613f8 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:36.358649 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab4674d0-310e-4a59-b61e-484005c613f8 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:36.359075 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab4674d0-310e-4a59-b61e-484005c613f8 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:36.417087 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-262381a6-af47-4b54-a42f-aaaeecac2b1b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "POST /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.000698 Sep 15 19:29:36.418317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 184/362] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:29:35 2022] POST /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/os-volume_attachments => generated 194 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:29:36.455550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-30317f1f-438c-459c-b7bd-72b170bca6fc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:36.460702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-30317f1f-438c-459c-b7bd-72b170bca6fc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:36.478185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30317f1f-438c-459c-b7bd-72b170bca6fc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:36.480179 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30317f1f-438c-459c-b7bd-72b170bca6fc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:36.483195 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30317f1f-438c-459c-b7bd-72b170bca6fc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:36.484553 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30317f1f-438c-459c-b7bd-72b170bca6fc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:36.487672 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30317f1f-438c-459c-b7bd-72b170bca6fc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:36.490252 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30317f1f-438c-459c-b7bd-72b170bca6fc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:36.493852 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ab4674d0-310e-4a59-b61e-484005c613f8 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:36.522668 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ab4674d0-310e-4a59-b61e-484005c613f8 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1272 microversion: 2.1 time: 0.177537 Sep 15 19:29:36.541556 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 179/363] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:36 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:36.556712 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6397fed9-6d01-4b0d-a75d-46850ef24ea8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:36.557589 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6397fed9-6d01-4b0d-a75d-46850ef24ea8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:36.565146 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6397fed9-6d01-4b0d-a75d-46850ef24ea8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:36.565930 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6397fed9-6d01-4b0d-a75d-46850ef24ea8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:36.566614 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6397fed9-6d01-4b0d-a75d-46850ef24ea8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:36.567560 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6397fed9-6d01-4b0d-a75d-46850ef24ea8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:36.568967 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6397fed9-6d01-4b0d-a75d-46850ef24ea8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:36.569564 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6397fed9-6d01-4b0d-a75d-46850ef24ea8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:36.667604 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-30317f1f-438c-459c-b7bd-72b170bca6fc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:36.687179 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-30317f1f-438c-459c-b7bd-72b170bca6fc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1461 microversion: 2.1 time: 0.267259 Sep 15 19:29:36.704674 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 185/364] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:36 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1461 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:36.709850 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-32e7e3d6-a03d-4908-9364-48fe1161d7e9 req-aa528c00-9ab0-4a60-82fd-74da81736798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212105c1-8435-430c-9ffa-72e8a6bd2426", "name": "network-vif-plugged", "status": "completed", "tag": "e07717f9-44fe-4be0-919e-d14afd6d6dcf"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:36.728993 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-32e7e3d6-a03d-4908-9364-48fe1161d7e9 req-aa528c00-9ab0-4a60-82fd-74da81736798 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:36.731825 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-32e7e3d6-a03d-4908-9364-48fe1161d7e9 req-aa528c00-9ab0-4a60-82fd-74da81736798 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:36.732488 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-32e7e3d6-a03d-4908-9364-48fe1161d7e9 req-aa528c00-9ab0-4a60-82fd-74da81736798 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:36.749408 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-32e7e3d6-a03d-4908-9364-48fe1161d7e9 req-aa528c00-9ab0-4a60-82fd-74da81736798 service nova] Creating event network-vif-plugged:e07717f9-44fe-4be0-919e-d14afd6d6dcf for instance 212105c1-8435-430c-9ffa-72e8a6bd2426 on hv-cinder-84984 Sep 15 19:29:36.756557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-32e7e3d6-a03d-4908-9364-48fe1161d7e9 req-aa528c00-9ab0-4a60-82fd-74da81736798 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049999 Sep 15 19:29:36.758258 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 186/365] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:36.764924 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-63a5974c-e874-4bc2-a2ba-e88411e46e9b req-6ebebdb6-9333-4396-b250-5db60141c590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4836cd00-5dd6-454d-84d6-643e1c0843c2", "name": "network-vif-deleted", "tag": "6a575adf-3c82-4218-b116-aeb619bfddcc"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:36.775577 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-63a5974c-e874-4bc2-a2ba-e88411e46e9b req-6ebebdb6-9333-4396-b250-5db60141c590 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:36.776277 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-63a5974c-e874-4bc2-a2ba-e88411e46e9b req-6ebebdb6-9333-4396-b250-5db60141c590 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:36.776908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-63a5974c-e874-4bc2-a2ba-e88411e46e9b req-6ebebdb6-9333-4396-b250-5db60141c590 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:36.804685 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-63a5974c-e874-4bc2-a2ba-e88411e46e9b req-6ebebdb6-9333-4396-b250-5db60141c590 service nova] Creating event network-vif-deleted:6a575adf-3c82-4218-b116-aeb619bfddcc for instance 4836cd00-5dd6-454d-84d6-643e1c0843c2 on hv-cinder-84984 Sep 15 19:29:36.814948 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-63a5974c-e874-4bc2-a2ba-e88411e46e9b req-6ebebdb6-9333-4396-b250-5db60141c590 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055064 Sep 15 19:29:36.817300 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 187/366] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:36.843286 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6397fed9-6d01-4b0d-a75d-46850ef24ea8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:36.855062 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6397fed9-6d01-4b0d-a75d-46850ef24ea8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.311995 Sep 15 19:29:36.876687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 180/367] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:36 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:37.324323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:37.328937 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-573429a8-5661-4dd1-a8b2-c88b86c0295d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:37.329437 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-573429a8-5661-4dd1-a8b2-c88b86c0295d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:37.342064 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-573429a8-5661-4dd1-a8b2-c88b86c0295d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:37.342560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-573429a8-5661-4dd1-a8b2-c88b86c0295d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:37.343003 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-573429a8-5661-4dd1-a8b2-c88b86c0295d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:37.343879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-573429a8-5661-4dd1-a8b2-c88b86c0295d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:37.344197 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-573429a8-5661-4dd1-a8b2-c88b86c0295d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:37.344624 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-573429a8-5661-4dd1-a8b2-c88b86c0295d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:37.554627 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2f11c4d-70f5-4e17-ad16-d2a22586a054 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:37.561635 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d2f11c4d-70f5-4e17-ad16-d2a22586a054 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:37.567093 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:37.583035 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2f11c4d-70f5-4e17-ad16-d2a22586a054 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:37.583466 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2f11c4d-70f5-4e17-ad16-d2a22586a054 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:37.583991 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2f11c4d-70f5-4e17-ad16-d2a22586a054 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:37.589145 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2f11c4d-70f5-4e17-ad16-d2a22586a054 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:37.589681 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2f11c4d-70f5-4e17-ad16-d2a22586a054 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:37.590128 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2f11c4d-70f5-4e17-ad16-d2a22586a054 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:37.668849 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-573429a8-5661-4dd1-a8b2-c88b86c0295d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:37.685991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-573429a8-5661-4dd1-a8b2-c88b86c0295d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.370479 Sep 15 19:29:37.687339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 188/368] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:37 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:37.710984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:37.711610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:37.725101 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:37.725589 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:37.726094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:37.726805 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:37.727254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:37.727903 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:37.765526 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:37.766020 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:37.766461 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:37.766922 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lazy-loading 'fault' on Instance uuid 4836cd00-5dd6-454d-84d6-643e1c0843c2 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:29:37.773904 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d2f11c4d-70f5-4e17-ad16-d2a22586a054 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:37.782490 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d2f11c4d-70f5-4e17-ad16-d2a22586a054 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1314 microversion: 2.1 time: 0.231697 Sep 15 19:29:37.788932 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 181/369] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:37 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:37.816623 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:37.826966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d3f0e2d7-c391-435a-94f2-3feeb87352d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1303 microversion: 2.1 time: 0.120114 Sep 15 19:29:37.827626 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 189/370] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:37 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:37.882297 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98aef515-7861-4c20-abe3-5591745fbad6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:37.882297 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98aef515-7861-4c20-abe3-5591745fbad6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:37.888154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98aef515-7861-4c20-abe3-5591745fbad6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:37.888798 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98aef515-7861-4c20-abe3-5591745fbad6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:37.889492 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98aef515-7861-4c20-abe3-5591745fbad6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:37.890653 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98aef515-7861-4c20-abe3-5591745fbad6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:37.891328 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98aef515-7861-4c20-abe3-5591745fbad6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:37.892029 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98aef515-7861-4c20-abe3-5591745fbad6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:38.052126 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-98aef515-7861-4c20-abe3-5591745fbad6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:38.063398 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98aef515-7861-4c20-abe3-5591745fbad6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.186669 Sep 15 19:29:38.064369 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 182/371] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:37 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:38.713203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-20652ac6-4bf4-4e53-885f-d42ffbbfb638 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:38.713991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-20652ac6-4bf4-4e53-885f-d42ffbbfb638 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:38.716296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=8 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:38.717091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:38.721996 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20652ac6-4bf4-4e53-885f-d42ffbbfb638 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:38.722481 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20652ac6-4bf4-4e53-885f-d42ffbbfb638 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:38.722926 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20652ac6-4bf4-4e53-885f-d42ffbbfb638 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:38.723622 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20652ac6-4bf4-4e53-885f-d42ffbbfb638 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:38.724133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20652ac6-4bf4-4e53-885f-d42ffbbfb638 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:38.724602 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20652ac6-4bf4-4e53-885f-d42ffbbfb638 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:38.807312 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f2a9b3b-a67e-411c-a07b-8309608ee2e5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:38.808120 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7f2a9b3b-a67e-411c-a07b-8309608ee2e5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:38.823007 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f2a9b3b-a67e-411c-a07b-8309608ee2e5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:38.823817 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f2a9b3b-a67e-411c-a07b-8309608ee2e5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:38.824250 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f2a9b3b-a67e-411c-a07b-8309608ee2e5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:38.825130 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f2a9b3b-a67e-411c-a07b-8309608ee2e5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:38.825730 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f2a9b3b-a67e-411c-a07b-8309608ee2e5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:38.826302 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f2a9b3b-a67e-411c-a07b-8309608ee2e5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:38.919952 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-20652ac6-4bf4-4e53-885f-d42ffbbfb638 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:38.934920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-20652ac6-4bf4-4e53-885f-d42ffbbfb638 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.226020 Sep 15 19:29:38.941907 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 190/372] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:38 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:38.941907 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-edda7ea9-f171-4187-9bc1-2bb6343a9e95 req-e874c10c-7402-497b-a0b7-3d598d86425d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b", "tag": "6363c3da-31b1-4c7f-be7c-41a310dc3789"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:38.950809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-edda7ea9-f171-4187-9bc1-2bb6343a9e95 req-e874c10c-7402-497b-a0b7-3d598d86425d service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:38.951293 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-edda7ea9-f171-4187-9bc1-2bb6343a9e95 req-e874c10c-7402-497b-a0b7-3d598d86425d service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:38.951774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-edda7ea9-f171-4187-9bc1-2bb6343a9e95 req-e874c10c-7402-497b-a0b7-3d598d86425d service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:38.963439 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-edda7ea9-f171-4187-9bc1-2bb6343a9e95 req-e874c10c-7402-497b-a0b7-3d598d86425d service nova] Creating event network-changed:6363c3da-31b1-4c7f-be7c-41a310dc3789 for instance bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b on hv-cinder-84984 Sep 15 19:29:38.969653 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-edda7ea9-f171-4187-9bc1-2bb6343a9e95 req-e874c10c-7402-497b-a0b7-3d598d86425d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032977 Sep 15 19:29:38.970266 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 191/373] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:38.975348 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:38.976160 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:38.982135 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:38.982621 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:38.983065 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:38.983870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:38.984257 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:38.984684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:38.997986 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7f2a9b3b-a67e-411c-a07b-8309608ee2e5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:39.006509 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7f2a9b3b-a67e-411c-a07b-8309608ee2e5 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1314 microversion: 2.1 time: 0.203877 Sep 15 19:29:39.008214 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 183/374] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:38 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:39.011776 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-76861bf7-fa97-47cd-90c2-260737486c7b req-1b305876-4e29-4193-bdc9-d3a0a39a5db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdce58c-be13-4f4a-8a24-b3f3f002d77d", "name": "network-vif-plugged", "status": "completed", "tag": "1d0a2bca-ad01-4592-b8f5-ddac6af30dc4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:39.022793 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-76861bf7-fa97-47cd-90c2-260737486c7b req-1b305876-4e29-4193-bdc9-d3a0a39a5db5 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:39.028645 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-76861bf7-fa97-47cd-90c2-260737486c7b req-1b305876-4e29-4193-bdc9-d3a0a39a5db5 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:39.028645 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-76861bf7-fa97-47cd-90c2-260737486c7b req-1b305876-4e29-4193-bdc9-d3a0a39a5db5 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:39.029337 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:39.029337 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:39.029337 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:39.029337 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lazy-loading 'fault' on Instance uuid 4836cd00-5dd6-454d-84d6-643e1c0843c2 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:29:39.035981 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-76861bf7-fa97-47cd-90c2-260737486c7b req-1b305876-4e29-4193-bdc9-d3a0a39a5db5 service nova] Creating event network-vif-plugged:1d0a2bca-ad01-4592-b8f5-ddac6af30dc4 for instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d on hv-cinder-84984 Sep 15 19:29:39.041635 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-76861bf7-fa97-47cd-90c2-260737486c7b req-1b305876-4e29-4193-bdc9-d3a0a39a5db5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033301 Sep 15 19:29:39.042252 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 184/375] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:39.071621 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:39.075230 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:39.079324 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-de2a68a0-d473-4cf8-9398-7688a197a722 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 200 len: 1303 microversion: 2.1 time: 0.107945 Sep 15 19:29:39.079960 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 192/376] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:38 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:39.087579 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e733a55f-4eb3-4d14-b5ef-5d97825e1f67 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:39.088547 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e733a55f-4eb3-4d14-b5ef-5d97825e1f67 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:39.094629 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e733a55f-4eb3-4d14-b5ef-5d97825e1f67 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:39.095180 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e733a55f-4eb3-4d14-b5ef-5d97825e1f67 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:39.095632 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e733a55f-4eb3-4d14-b5ef-5d97825e1f67 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:39.096368 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e733a55f-4eb3-4d14-b5ef-5d97825e1f67 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:39.096825 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e733a55f-4eb3-4d14-b5ef-5d97825e1f67 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:39.097256 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e733a55f-4eb3-4d14-b5ef-5d97825e1f67 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:39.228312 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e733a55f-4eb3-4d14-b5ef-5d97825e1f67 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:39.236123 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e733a55f-4eb3-4d14-b5ef-5d97825e1f67 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1370 microversion: 2.1 time: 0.153310 Sep 15 19:29:39.236686 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 185/377] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:39 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:39.959811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5efd8d15-4e82-42a9-91f7-a3b21b2eb72c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:39.960446 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5efd8d15-4e82-42a9-91f7-a3b21b2eb72c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:39.969114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5efd8d15-4e82-42a9-91f7-a3b21b2eb72c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:39.969670 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5efd8d15-4e82-42a9-91f7-a3b21b2eb72c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:39.970138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5efd8d15-4e82-42a9-91f7-a3b21b2eb72c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:39.976282 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5efd8d15-4e82-42a9-91f7-a3b21b2eb72c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:39.976282 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5efd8d15-4e82-42a9-91f7-a3b21b2eb72c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:39.976282 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5efd8d15-4e82-42a9-91f7-a3b21b2eb72c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:40.030439 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f7054d9-ada4-40fe-99f1-d6040eb1f516 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:40.031051 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1f7054d9-ada4-40fe-99f1-d6040eb1f516 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:40.038138 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f7054d9-ada4-40fe-99f1-d6040eb1f516 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:40.038613 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f7054d9-ada4-40fe-99f1-d6040eb1f516 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:40.039111 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f7054d9-ada4-40fe-99f1-d6040eb1f516 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:40.039867 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f7054d9-ada4-40fe-99f1-d6040eb1f516 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:40.040380 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f7054d9-ada4-40fe-99f1-d6040eb1f516 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:40.040807 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f7054d9-ada4-40fe-99f1-d6040eb1f516 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:40.192941 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f7054d9-ada4-40fe-99f1-d6040eb1f516 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:40.194633 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5efd8d15-4e82-42a9-91f7-a3b21b2eb72c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:40.201725 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f7054d9-ada4-40fe-99f1-d6040eb1f516 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1314 microversion: 2.1 time: 0.175185 Sep 15 19:29:40.202302 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 186/378] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:40 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:40.203726 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5efd8d15-4e82-42a9-91f7-a3b21b2eb72c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1357 microversion: 2.1 time: 0.248587 Sep 15 19:29:40.204302 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 193/379] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:39 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1357 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:40.210113 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-20d8b1a9-9807-4639-a4ef-11692949775b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:40.211159 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-20d8b1a9-9807-4639-a4ef-11692949775b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: 4836cd00-5dd6-454d-84d6-643e1c0843c2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:40.220169 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20d8b1a9-9807-4639-a4ef-11692949775b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:40.220169 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20d8b1a9-9807-4639-a4ef-11692949775b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:40.220898 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20d8b1a9-9807-4639-a4ef-11692949775b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:40.221857 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20d8b1a9-9807-4639-a4ef-11692949775b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:40.222434 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20d8b1a9-9807-4639-a4ef-11692949775b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:40.223031 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20d8b1a9-9807-4639-a4ef-11692949775b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:40.241484 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-20d8b1a9-9807-4639-a4ef-11692949775b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] HTTP exception thrown: Instance 4836cd00-5dd6-454d-84d6-643e1c0843c2 could not be found. Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-20d8b1a9-9807-4639-a4ef-11692949775b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Request method failure captured: Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 HTTP/1.1 Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Connection: close Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Host: 10.222.0.18 Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjI3zxI0PQwGz-H7mE6rTGpZpwDZEwdJFlwdXc7jtANP4wo9oIjmzbfVnHhobZCPkdo1T9LoTKnm3PsBhwdrNE42_92k2nf3ozqEWlxGYEbdccbU4brJxY7imnOxmYo1pHoy4jRzGcqUtDbP0R5aw6g7XEnwqXtHyhbd0FDNFws1gSMbw Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Id: cf90b9345ae84e26b58e9238da0dac2e Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesActionsTest-1580950199 Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Role: member,reader Sep 15 19:29:40.243757 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Roles: member,reader Sep 15 19:29:40.245350 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf90b9345ae84e26b58e9238da0dac2e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf90b9345ae84e26b58e9238da0dac2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf90b9345ae84e26b58e9238da0dac2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf90b9345ae84e26b58e9238da0dac2e"}]}] Sep 15 19:29:40.245350 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-VolumesActionsTest-1580950199 Sep 15 19:29:40.245350 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Id: cf90b9345ae84e26b58e9238da0dac2e Sep 15 19:29:40.245350 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesActionsTest-1580950199 Sep 15 19:29:40.245350 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User: tempest-VolumesActionsTest-1580950199-project Sep 15 19:29:40.245350 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 15 19:29:40.245350 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 15 19:29:40.245350 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Id: 7de2f8a8c6644220b9e1ed37a48b7d9a Sep 15 19:29:40.245350 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-VolumesActionsTest-1580950199-project Sep 15 19:29:40.245350 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: method: > Sep 15 19:29:40.245350 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: exception: Instance 4836cd00-5dd6-454d-84d6-643e1c0843c2 could not be found. Sep 15 19:29:40.245350 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: action_args: {'id': '4836cd00-5dd6-454d-84d6-643e1c0843c2'} Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4836cd00-5dd6-454d-84d6-643e1c0843c2 could not be found. Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:29:40.246367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4836cd00-5dd6-454d-84d6-643e1c0843c2 could not be found. Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4836cd00-5dd6-454d-84d6-643e1c0843c2 could not be found. Sep 15 19:29:40.251381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:29:40.253275 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-20d8b1a9-9807-4639-a4ef-11692949775b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Returning 404 to user: Instance 4836cd00-5dd6-454d-84d6-643e1c0843c2 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:29:40.253275 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-20d8b1a9-9807-4639-a4ef-11692949775b tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2" status: 404 len: 111 microversion: 2.1 time: 0.042042 Sep 15 19:29:40.253275 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 187/380] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:40 2022] GET /compute/v2.1/servers/4836cd00-5dd6-454d-84d6-643e1c0843c2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:29:40.267412 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-573c48bd-c94e-477e-aa39-b28b3cce91fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:40.268061 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-573c48bd-c94e-477e-aa39-b28b3cce91fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:40.274853 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-573c48bd-c94e-477e-aa39-b28b3cce91fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:40.275336 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-573c48bd-c94e-477e-aa39-b28b3cce91fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:40.275828 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-573c48bd-c94e-477e-aa39-b28b3cce91fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:40.276536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-573c48bd-c94e-477e-aa39-b28b3cce91fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:40.276991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-573c48bd-c94e-477e-aa39-b28b3cce91fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:40.277414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-573c48bd-c94e-477e-aa39-b28b3cce91fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:40.363286 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-417155453", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "networks": [{"uuid": "1c551f32-2b72-43e2-b898-66bfeafd2424"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:40.418949 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] validate_networks() for [('1c551f32-2b72-43e2-b898-66bfeafd2424', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:29:40.423133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-573c48bd-c94e-477e-aa39-b28b3cce91fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:40.432318 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-573c48bd-c94e-477e-aa39-b28b3cce91fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1564 microversion: 2.1 time: 0.168685 Sep 15 19:29:40.432932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 194/381] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:40 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:40.455504 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b492b065-1d7b-448d-918c-a47539878d29 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:40.456030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b492b065-1d7b-448d-918c-a47539878d29 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:40.462980 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b492b065-1d7b-448d-918c-a47539878d29 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:40.463395 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b492b065-1d7b-448d-918c-a47539878d29 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:40.463875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b492b065-1d7b-448d-918c-a47539878d29 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:40.464773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b492b065-1d7b-448d-918c-a47539878d29 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:40.465231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b492b065-1d7b-448d-918c-a47539878d29 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:40.465657 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b492b065-1d7b-448d-918c-a47539878d29 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:40.542699 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b492b065-1d7b-448d-918c-a47539878d29 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091016 Sep 15 19:29:40.543444 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 195/382] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 15 19:29:40 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:29:41.072415 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:29:41.072875 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:29:41.073326 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:29:41.073739 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:29:41.074276 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:29:41.076529 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:41.090721 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:41.091998 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:41.092782 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:41.094094 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:41.095040 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:41.096133 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:41.121661 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Getting quotas for project cf90b9345ae84e26b58e9238da0dac2e. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:29:41.126385 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Getting quotas for user 7de2f8a8c6644220b9e1ed37a48b7d9a and project cf90b9345ae84e26b58e9238da0dac2e. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:29:41.139368 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:29:41.141866 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:29:41.226763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2119c998-e319-4ccf-9579-e6e52e11a2fb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:41.228397 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2119c998-e319-4ccf-9579-e6e52e11a2fb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:41.235716 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2119c998-e319-4ccf-9579-e6e52e11a2fb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:41.239773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2119c998-e319-4ccf-9579-e6e52e11a2fb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:41.239773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2119c998-e319-4ccf-9579-e6e52e11a2fb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:41.239773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2119c998-e319-4ccf-9579-e6e52e11a2fb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:41.239773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2119c998-e319-4ccf-9579-e6e52e11a2fb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:41.240800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2119c998-e319-4ccf-9579-e6e52e11a2fb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:41.273552 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-38037525-1712-4e76-ab6f-504629cc1b45 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913958 Sep 15 19:29:41.274317 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 188/383] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:29:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 19:29:41.280953 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5353187a-ea10-46b7-a4c1-a8c92030c7fe tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:41.280953 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5353187a-ea10-46b7-a4c1-a8c92030c7fe tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:41.289268 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5353187a-ea10-46b7-a4c1-a8c92030c7fe tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:41.289934 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5353187a-ea10-46b7-a4c1-a8c92030c7fe tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:41.296182 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5353187a-ea10-46b7-a4c1-a8c92030c7fe tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:41.296182 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5353187a-ea10-46b7-a4c1-a8c92030c7fe tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:41.296182 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5353187a-ea10-46b7-a4c1-a8c92030c7fe tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:41.296182 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5353187a-ea10-46b7-a4c1-a8c92030c7fe tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:41.415249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2119c998-e319-4ccf-9579-e6e52e11a2fb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:41.432912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2119c998-e319-4ccf-9579-e6e52e11a2fb tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1314 microversion: 2.1 time: 0.209680 Sep 15 19:29:41.432912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 196/384] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:41 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:41.439348 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8b40ee43-77d1-4c25-bf70-d0391bb02f66 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:41.440342 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8b40ee43-77d1-4c25-bf70-d0391bb02f66 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:41.504177 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8b40ee43-77d1-4c25-bf70-d0391bb02f66 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:41.522110 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8b40ee43-77d1-4c25-bf70-d0391bb02f66 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1213 microversion: 2.1 time: 0.087463 Sep 15 19:29:41.522110 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 197/385] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:41 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:41.598933 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5353187a-ea10-46b7-a4c1-a8c92030c7fe tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:41.608605 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5353187a-ea10-46b7-a4c1-a8c92030c7fe tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1546 microversion: 2.1 time: 0.333251 Sep 15 19:29:41.609408 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 189/386] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:41 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1546 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:41.634217 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6b828d1c-b40f-4f56-8fad-e098f1c2ab8e tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:41.635548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6b828d1c-b40f-4f56-8fad-e098f1c2ab8e tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:41.642675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b828d1c-b40f-4f56-8fad-e098f1c2ab8e tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:41.643138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b828d1c-b40f-4f56-8fad-e098f1c2ab8e tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:41.643581 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b828d1c-b40f-4f56-8fad-e098f1c2ab8e tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:41.644312 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b828d1c-b40f-4f56-8fad-e098f1c2ab8e tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:41.644771 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b828d1c-b40f-4f56-8fad-e098f1c2ab8e tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:41.645232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b828d1c-b40f-4f56-8fad-e098f1c2ab8e tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:41.810321 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6b828d1c-b40f-4f56-8fad-e098f1c2ab8e tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:41.819441 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6b828d1c-b40f-4f56-8fad-e098f1c2ab8e tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1546 microversion: 2.1 time: 0.190313 Sep 15 19:29:41.824208 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 198/387] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:41 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1546 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:41.848430 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aec18501-6cee-46f2-8d45-4ba44b3f986d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:41.853317 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-aec18501-6cee-46f2-8d45-4ba44b3f986d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:41.854107 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aec18501-6cee-46f2-8d45-4ba44b3f986d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Searching by: {'deleted': False, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 15 19:29:41.861660 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aec18501-6cee-46f2-8d45-4ba44b3f986d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:41.863140 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aec18501-6cee-46f2-8d45-4ba44b3f986d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:41.863140 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aec18501-6cee-46f2-8d45-4ba44b3f986d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:41.863355 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aec18501-6cee-46f2-8d45-4ba44b3f986d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:41.863813 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aec18501-6cee-46f2-8d45-4ba44b3f986d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:41.864242 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aec18501-6cee-46f2-8d45-4ba44b3f986d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:41.976424 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-aec18501-6cee-46f2-8d45-4ba44b3f986d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 15 19:29:42.117065 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aec18501-6cee-46f2-8d45-4ba44b3f986d tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.272774 Sep 15 19:29:42.117964 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 190/388] 10.222.0.18 () {58 vars in 1125 bytes} [Thu Sep 15 19:29:41 2022] GET /compute/v2.1/servers => generated 342 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:42.129408 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8e71c135-a756-4b9a-bfbd-cc98e08ea8e2 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:42.130340 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8e71c135-a756-4b9a-bfbd-cc98e08ea8e2 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:42.137506 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e71c135-a756-4b9a-bfbd-cc98e08ea8e2 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:42.138120 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e71c135-a756-4b9a-bfbd-cc98e08ea8e2 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:42.138791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e71c135-a756-4b9a-bfbd-cc98e08ea8e2 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:42.139588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e71c135-a756-4b9a-bfbd-cc98e08ea8e2 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:42.141130 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e71c135-a756-4b9a-bfbd-cc98e08ea8e2 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:42.141758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e71c135-a756-4b9a-bfbd-cc98e08ea8e2 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:42.233048 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-942d882c-040e-4882-9ffa-648b4340908a req-121e29bf-5362-4d93-b1ae-2d8bc6c37f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "212105c1-8435-430c-9ffa-72e8a6bd2426", "tag": "e07717f9-44fe-4be0-919e-d14afd6d6dcf"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:42.246914 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-942d882c-040e-4882-9ffa-648b4340908a req-121e29bf-5362-4d93-b1ae-2d8bc6c37f27 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:42.252081 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-942d882c-040e-4882-9ffa-648b4340908a req-121e29bf-5362-4d93-b1ae-2d8bc6c37f27 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:42.252081 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-942d882c-040e-4882-9ffa-648b4340908a req-121e29bf-5362-4d93-b1ae-2d8bc6c37f27 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:42.269310 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-942d882c-040e-4882-9ffa-648b4340908a req-121e29bf-5362-4d93-b1ae-2d8bc6c37f27 service nova] Creating event network-changed:e07717f9-44fe-4be0-919e-d14afd6d6dcf for instance 212105c1-8435-430c-9ffa-72e8a6bd2426 on hv-cinder-84984 Sep 15 19:29:42.278877 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-942d882c-040e-4882-9ffa-648b4340908a req-121e29bf-5362-4d93-b1ae-2d8bc6c37f27 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049577 Sep 15 19:29:42.280233 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 191/389] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:29:42.306027 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8e71c135-a756-4b9a-bfbd-cc98e08ea8e2 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:42.315740 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8e71c135-a756-4b9a-bfbd-cc98e08ea8e2 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1546 microversion: 2.1 time: 0.190212 Sep 15 19:29:42.316314 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 199/390] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:42 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1546 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:42.467466 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c75a4f8a-d006-4895-8846-9186b2f9e13b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:42.467466 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c75a4f8a-d006-4895-8846-9186b2f9e13b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:42.476968 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c75a4f8a-d006-4895-8846-9186b2f9e13b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:42.478167 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c75a4f8a-d006-4895-8846-9186b2f9e13b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:42.478167 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c75a4f8a-d006-4895-8846-9186b2f9e13b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:42.478715 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c75a4f8a-d006-4895-8846-9186b2f9e13b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:42.479193 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c75a4f8a-d006-4895-8846-9186b2f9e13b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:42.479821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c75a4f8a-d006-4895-8846-9186b2f9e13b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:42.547928 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2ec3509e-ebbe-412b-bafb-142e6a2a9509 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:42.548928 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2ec3509e-ebbe-412b-bafb-142e6a2a9509 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:42.558062 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ec3509e-ebbe-412b-bafb-142e6a2a9509 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:42.558804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ec3509e-ebbe-412b-bafb-142e6a2a9509 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:42.559249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ec3509e-ebbe-412b-bafb-142e6a2a9509 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:42.561944 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ec3509e-ebbe-412b-bafb-142e6a2a9509 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:42.562642 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ec3509e-ebbe-412b-bafb-142e6a2a9509 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:42.563148 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ec3509e-ebbe-412b-bafb-142e6a2a9509 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:42.663642 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c75a4f8a-d006-4895-8846-9186b2f9e13b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:42.670420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2ec3509e-ebbe-412b-bafb-142e6a2a9509 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:42.678517 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c75a4f8a-d006-4895-8846-9186b2f9e13b tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1314 microversion: 2.1 time: 0.215390 Sep 15 19:29:42.694639 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 192/391] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:42 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:42.712675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2ec3509e-ebbe-412b-bafb-142e6a2a9509 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1217 microversion: 2.1 time: 0.168731 Sep 15 19:29:42.723776 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 200/392] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:42 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:43.702528 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6d6fc1fd-839b-4fd9-8dfa-948033ad94dc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:43.703169 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6d6fc1fd-839b-4fd9-8dfa-948033ad94dc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:43.719869 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d6fc1fd-839b-4fd9-8dfa-948033ad94dc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:43.719869 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d6fc1fd-839b-4fd9-8dfa-948033ad94dc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:43.719869 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d6fc1fd-839b-4fd9-8dfa-948033ad94dc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:43.719869 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d6fc1fd-839b-4fd9-8dfa-948033ad94dc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:43.720866 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d6fc1fd-839b-4fd9-8dfa-948033ad94dc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:43.720866 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d6fc1fd-839b-4fd9-8dfa-948033ad94dc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:43.720866 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:43.750368 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-108c4f2c-efc1-4b7d-aaf3-ff3ec6cdbced tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:43.751038 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-108c4f2c-efc1-4b7d-aaf3-ff3ec6cdbced tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:43.769010 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-108c4f2c-efc1-4b7d-aaf3-ff3ec6cdbced tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:43.769010 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-108c4f2c-efc1-4b7d-aaf3-ff3ec6cdbced tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:43.769010 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-108c4f2c-efc1-4b7d-aaf3-ff3ec6cdbced tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:43.769010 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-108c4f2c-efc1-4b7d-aaf3-ff3ec6cdbced tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:43.769381 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-108c4f2c-efc1-4b7d-aaf3-ff3ec6cdbced tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:43.769381 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-108c4f2c-efc1-4b7d-aaf3-ff3ec6cdbced tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:43.838779 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-108c4f2c-efc1-4b7d-aaf3-ff3ec6cdbced tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:43.847231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-108c4f2c-efc1-4b7d-aaf3-ff3ec6cdbced tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1209 microversion: 2.1 time: 0.100647 Sep 15 19:29:43.848216 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 201/393] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:43 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1209 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:43.867232 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6d6fc1fd-839b-4fd9-8dfa-948033ad94dc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:43.875203 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6d6fc1fd-839b-4fd9-8dfa-948033ad94dc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1314 microversion: 2.1 time: 0.176625 Sep 15 19:29:43.875964 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 193/394] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:43 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:44.386407 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-50a9a65b-d8c9-4b2f-b424-76ce71a1cecb tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ef7fded-bad3-4c9a-b933-94a88fdca896"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:44.388895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-50a9a65b-d8c9-4b2f-b424-76ce71a1cecb tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:44.395016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50a9a65b-d8c9-4b2f-b424-76ce71a1cecb tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:44.395492 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50a9a65b-d8c9-4b2f-b424-76ce71a1cecb tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:44.395969 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50a9a65b-d8c9-4b2f-b424-76ce71a1cecb tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:44.397221 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50a9a65b-d8c9-4b2f-b424-76ce71a1cecb tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:44.397699 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50a9a65b-d8c9-4b2f-b424-76ce71a1cecb tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:44.398127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50a9a65b-d8c9-4b2f-b424-76ce71a1cecb tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:44.878649 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b73e8443-d6d7-440f-88df-9b7bfecce50e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:44.879213 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b73e8443-d6d7-440f-88df-9b7bfecce50e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:44.886765 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b73e8443-d6d7-440f-88df-9b7bfecce50e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:44.887246 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b73e8443-d6d7-440f-88df-9b7bfecce50e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:44.887701 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b73e8443-d6d7-440f-88df-9b7bfecce50e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:44.888401 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b73e8443-d6d7-440f-88df-9b7bfecce50e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:44.888851 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b73e8443-d6d7-440f-88df-9b7bfecce50e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:44.889274 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b73e8443-d6d7-440f-88df-9b7bfecce50e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:44.950400 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b73e8443-d6d7-440f-88df-9b7bfecce50e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:44.958738 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b73e8443-d6d7-440f-88df-9b7bfecce50e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1209 microversion: 2.1 time: 0.084025 Sep 15 19:29:44.959963 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 194/395] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:44 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:44.964199 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-537e8888-1f4a-4f9f-b719-39ecfc545a81 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:44.964796 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-537e8888-1f4a-4f9f-b719-39ecfc545a81 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:44.970671 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-537e8888-1f4a-4f9f-b719-39ecfc545a81 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:44.971150 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-537e8888-1f4a-4f9f-b719-39ecfc545a81 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:44.971582 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-537e8888-1f4a-4f9f-b719-39ecfc545a81 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:44.972296 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-537e8888-1f4a-4f9f-b719-39ecfc545a81 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:44.972763 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-537e8888-1f4a-4f9f-b719-39ecfc545a81 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:44.973159 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-537e8888-1f4a-4f9f-b719-39ecfc545a81 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:45.108574 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-537e8888-1f4a-4f9f-b719-39ecfc545a81 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:45.118965 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-537e8888-1f4a-4f9f-b719-39ecfc545a81 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1314 microversion: 2.1 time: 0.158087 Sep 15 19:29:45.119535 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 195/396] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:44 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:45.981750 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce695eea-c05f-4ff3-bf1c-0b71f3b68eab tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:45.982356 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ce695eea-c05f-4ff3-bf1c-0b71f3b68eab tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:45.988900 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce695eea-c05f-4ff3-bf1c-0b71f3b68eab tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:45.989376 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce695eea-c05f-4ff3-bf1c-0b71f3b68eab tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:45.989811 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce695eea-c05f-4ff3-bf1c-0b71f3b68eab tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:45.990497 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce695eea-c05f-4ff3-bf1c-0b71f3b68eab tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:45.990950 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce695eea-c05f-4ff3-bf1c-0b71f3b68eab tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:45.991372 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce695eea-c05f-4ff3-bf1c-0b71f3b68eab tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:46.056053 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ce695eea-c05f-4ff3-bf1c-0b71f3b68eab tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:46.063901 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce695eea-c05f-4ff3-bf1c-0b71f3b68eab tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1209 microversion: 2.1 time: 0.085954 Sep 15 19:29:46.064480 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 196/397] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:45 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:46.143938 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f1ffe6a-0797-49c3-a9c9-77db2c14e97d tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:46.144583 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8f1ffe6a-0797-49c3-a9c9-77db2c14e97d tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:46.151201 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f1ffe6a-0797-49c3-a9c9-77db2c14e97d tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:46.151719 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f1ffe6a-0797-49c3-a9c9-77db2c14e97d tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:46.152163 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f1ffe6a-0797-49c3-a9c9-77db2c14e97d tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:46.152859 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f1ffe6a-0797-49c3-a9c9-77db2c14e97d tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:46.153307 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f1ffe6a-0797-49c3-a9c9-77db2c14e97d tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:46.153744 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f1ffe6a-0797-49c3-a9c9-77db2c14e97d tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:46.293525 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8f1ffe6a-0797-49c3-a9c9-77db2c14e97d tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:46.302114 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8f1ffe6a-0797-49c3-a9c9-77db2c14e97d tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1314 microversion: 2.1 time: 0.163547 Sep 15 19:29:46.302798 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 197/398] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:46 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:46.307704 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f9f6fba2-4348-4546-bbde-ed9da7c4c051 req-882ded1f-61d6-4521-ba00-a806f0aa7722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b", "name": "network-vif-plugged", "status": "completed", "tag": "6363c3da-31b1-4c7f-be7c-41a310dc3789"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:46.317349 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f9f6fba2-4348-4546-bbde-ed9da7c4c051 req-882ded1f-61d6-4521-ba00-a806f0aa7722 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:46.317935 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f9f6fba2-4348-4546-bbde-ed9da7c4c051 req-882ded1f-61d6-4521-ba00-a806f0aa7722 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:46.318917 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f9f6fba2-4348-4546-bbde-ed9da7c4c051 req-882ded1f-61d6-4521-ba00-a806f0aa7722 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:46.330082 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f9f6fba2-4348-4546-bbde-ed9da7c4c051 req-882ded1f-61d6-4521-ba00-a806f0aa7722 service nova] Creating event network-vif-plugged:6363c3da-31b1-4c7f-be7c-41a310dc3789 for instance bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b on hv-cinder-84984 Sep 15 19:29:46.335597 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f9f6fba2-4348-4546-bbde-ed9da7c4c051 req-882ded1f-61d6-4521-ba00-a806f0aa7722 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031658 Sep 15 19:29:46.336212 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 198/399] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:47.087597 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7afbdee1-2f77-4cca-883e-3f226585ab07 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:47.088283 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7afbdee1-2f77-4cca-883e-3f226585ab07 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:47.094737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7afbdee1-2f77-4cca-883e-3f226585ab07 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:47.095220 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7afbdee1-2f77-4cca-883e-3f226585ab07 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:47.095672 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7afbdee1-2f77-4cca-883e-3f226585ab07 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:47.096379 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7afbdee1-2f77-4cca-883e-3f226585ab07 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:47.096833 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7afbdee1-2f77-4cca-883e-3f226585ab07 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:47.097283 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7afbdee1-2f77-4cca-883e-3f226585ab07 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:47.159635 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7afbdee1-2f77-4cca-883e-3f226585ab07 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:47.167978 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7afbdee1-2f77-4cca-883e-3f226585ab07 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1209 microversion: 2.1 time: 0.085239 Sep 15 19:29:47.168551 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 199/400] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:47 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:47.332557 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-896439f6-3780-429f-b330-dd64e34aeaf3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:47.333169 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-896439f6-3780-429f-b330-dd64e34aeaf3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:47.343372 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-896439f6-3780-429f-b330-dd64e34aeaf3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:47.343372 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-896439f6-3780-429f-b330-dd64e34aeaf3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:47.343372 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-896439f6-3780-429f-b330-dd64e34aeaf3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:47.343372 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-896439f6-3780-429f-b330-dd64e34aeaf3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:47.344366 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-896439f6-3780-429f-b330-dd64e34aeaf3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:47.344366 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-896439f6-3780-429f-b330-dd64e34aeaf3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:47.479857 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-896439f6-3780-429f-b330-dd64e34aeaf3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:47.487987 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-896439f6-3780-429f-b330-dd64e34aeaf3 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1314 microversion: 2.1 time: 0.159320 Sep 15 19:29:47.488554 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 200/401] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:47 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:48.200703 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1871571a-1984-49aa-a8b5-2094d23993e6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:48.201490 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1871571a-1984-49aa-a8b5-2094d23993e6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:48.207792 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1871571a-1984-49aa-a8b5-2094d23993e6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:48.208269 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1871571a-1984-49aa-a8b5-2094d23993e6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:48.208701 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1871571a-1984-49aa-a8b5-2094d23993e6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:48.209380 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1871571a-1984-49aa-a8b5-2094d23993e6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:48.209824 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1871571a-1984-49aa-a8b5-2094d23993e6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:48.210276 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1871571a-1984-49aa-a8b5-2094d23993e6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:48.280382 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1871571a-1984-49aa-a8b5-2094d23993e6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:48.288471 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1871571a-1984-49aa-a8b5-2094d23993e6 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1209 microversion: 2.1 time: 0.091673 Sep 15 19:29:48.289286 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 201/402] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:48 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:48.511035 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c9e2f3cd-3b19-4c35-9efe-bc7b47d89185 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:48.512288 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c9e2f3cd-3b19-4c35-9efe-bc7b47d89185 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:48.519167 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9e2f3cd-3b19-4c35-9efe-bc7b47d89185 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:48.519875 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9e2f3cd-3b19-4c35-9efe-bc7b47d89185 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:48.520574 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9e2f3cd-3b19-4c35-9efe-bc7b47d89185 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:48.521420 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9e2f3cd-3b19-4c35-9efe-bc7b47d89185 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:48.522143 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9e2f3cd-3b19-4c35-9efe-bc7b47d89185 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:48.522716 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9e2f3cd-3b19-4c35-9efe-bc7b47d89185 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:48.729719 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c9e2f3cd-3b19-4c35-9efe-bc7b47d89185 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:48.737958 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c9e2f3cd-3b19-4c35-9efe-bc7b47d89185 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1314 microversion: 2.1 time: 0.231081 Sep 15 19:29:48.738868 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 202/403] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:48 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:49.166952 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-50a9a65b-d8c9-4b2f-b424-76ce71a1cecb tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "POST /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.784368 Sep 15 19:29:49.167570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 202/404] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:29:44 2022] POST /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/os-volume_attachments => generated 194 bytes in 4786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:49.311603 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-22169c74-1f2b-4387-9f5b-0898f531c700 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:49.312316 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-22169c74-1f2b-4387-9f5b-0898f531c700 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:49.318946 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22169c74-1f2b-4387-9f5b-0898f531c700 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:49.319415 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22169c74-1f2b-4387-9f5b-0898f531c700 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:49.319910 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22169c74-1f2b-4387-9f5b-0898f531c700 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:49.320632 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22169c74-1f2b-4387-9f5b-0898f531c700 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:49.321080 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22169c74-1f2b-4387-9f5b-0898f531c700 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:49.321496 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22169c74-1f2b-4387-9f5b-0898f531c700 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:49.389942 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-22169c74-1f2b-4387-9f5b-0898f531c700 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:49.403062 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-22169c74-1f2b-4387-9f5b-0898f531c700 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1209 microversion: 2.1 time: 0.095210 Sep 15 19:29:49.403818 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 203/405] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:49 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:49.762365 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-62afd849-3001-49ab-9739-5f2921fec3f7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:49.763115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-62afd849-3001-49ab-9739-5f2921fec3f7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:49.769510 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62afd849-3001-49ab-9739-5f2921fec3f7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:49.769992 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62afd849-3001-49ab-9739-5f2921fec3f7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:49.770429 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62afd849-3001-49ab-9739-5f2921fec3f7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:49.771177 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62afd849-3001-49ab-9739-5f2921fec3f7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:49.771625 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62afd849-3001-49ab-9739-5f2921fec3f7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:49.772086 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62afd849-3001-49ab-9739-5f2921fec3f7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:49.910393 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-62afd849-3001-49ab-9739-5f2921fec3f7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:49.918418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-62afd849-3001-49ab-9739-5f2921fec3f7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1314 microversion: 2.1 time: 0.161574 Sep 15 19:29:49.918990 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 203/406] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:49 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:50.432271 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d8b089bb-8881-48d9-bae4-111012322ec5 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:50.433101 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d8b089bb-8881-48d9-bae4-111012322ec5 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:50.441195 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8b089bb-8881-48d9-bae4-111012322ec5 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:50.441771 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8b089bb-8881-48d9-bae4-111012322ec5 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:50.442241 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8b089bb-8881-48d9-bae4-111012322ec5 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:50.444671 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8b089bb-8881-48d9-bae4-111012322ec5 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:50.444671 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8b089bb-8881-48d9-bae4-111012322ec5 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:50.444671 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8b089bb-8881-48d9-bae4-111012322ec5 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:50.515264 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d8b089bb-8881-48d9-bae4-111012322ec5 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:50.523553 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d8b089bb-8881-48d9-bae4-111012322ec5 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1265 microversion: 2.1 time: 0.094977 Sep 15 19:29:50.524168 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 204/407] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:50 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:50.558163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8726d4f8-6918-450c-aaad-9386b9c68a4b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:50.564542 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8726d4f8-6918-450c-aaad-9386b9c68a4b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:50.565023 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8726d4f8-6918-450c-aaad-9386b9c68a4b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:50.565491 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8726d4f8-6918-450c-aaad-9386b9c68a4b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:50.627362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8726d4f8-6918-450c-aaad-9386b9c68a4b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Going to try to stop instance {{(pid=121041) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 15 19:29:50.840979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8726d4f8-6918-450c-aaad-9386b9c68a4b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "POST /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/action" status: 202 len: 0 microversion: 2.1 time: 0.286755 Sep 15 19:29:50.841573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 204/408] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:29:50 2022] POST /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:29:50.849890 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dd3224fb-1002-413b-9b78-fa14e70cfc3a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:50.850649 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dd3224fb-1002-413b-9b78-fa14e70cfc3a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:50.857503 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd3224fb-1002-413b-9b78-fa14e70cfc3a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:50.858450 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd3224fb-1002-413b-9b78-fa14e70cfc3a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:50.859071 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd3224fb-1002-413b-9b78-fa14e70cfc3a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:50.859995 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd3224fb-1002-413b-9b78-fa14e70cfc3a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:50.863129 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd3224fb-1002-413b-9b78-fa14e70cfc3a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:50.863129 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd3224fb-1002-413b-9b78-fa14e70cfc3a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:50.943790 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-89221aef-079a-4e1a-aaab-5d50df12f0bc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:50.945000 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-89221aef-079a-4e1a-aaab-5d50df12f0bc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:50.951975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89221aef-079a-4e1a-aaab-5d50df12f0bc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:50.952391 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89221aef-079a-4e1a-aaab-5d50df12f0bc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:50.952785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89221aef-079a-4e1a-aaab-5d50df12f0bc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:50.953540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89221aef-079a-4e1a-aaab-5d50df12f0bc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:50.954004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89221aef-079a-4e1a-aaab-5d50df12f0bc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:50.954432 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89221aef-079a-4e1a-aaab-5d50df12f0bc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:51.016699 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-dd3224fb-1002-413b-9b78-fa14e70cfc3a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:51.027732 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dd3224fb-1002-413b-9b78-fa14e70cfc3a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1724 microversion: 2.1 time: 0.181759 Sep 15 19:29:51.028659 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 205/409] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:50 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:51.137381 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-89221aef-079a-4e1a-aaab-5d50df12f0bc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:51.145708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-89221aef-079a-4e1a-aaab-5d50df12f0bc tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1314 microversion: 2.1 time: 0.206797 Sep 15 19:29:51.146209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 205/410] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:50 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:51.547374 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-40940850-d05e-40ba-ae34-7e03487a4a49 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:51.548018 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-40940850-d05e-40ba-ae34-7e03487a4a49 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:51.550176 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:51.556778 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40940850-d05e-40ba-ae34-7e03487a4a49 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:51.557264 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40940850-d05e-40ba-ae34-7e03487a4a49 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:51.557699 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40940850-d05e-40ba-ae34-7e03487a4a49 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:51.558391 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40940850-d05e-40ba-ae34-7e03487a4a49 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:51.559014 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40940850-d05e-40ba-ae34-7e03487a4a49 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:51.559254 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40940850-d05e-40ba-ae34-7e03487a4a49 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:51.637164 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-40940850-d05e-40ba-ae34-7e03487a4a49 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:51.645110 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-40940850-d05e-40ba-ae34-7e03487a4a49 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1265 microversion: 2.1 time: 0.101643 Sep 15 19:29:51.645681 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 206/411] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:51 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:52.052251 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0e82aa1c-604f-4fcd-b4fc-62220c3323e2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:52.053019 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0e82aa1c-604f-4fcd-b4fc-62220c3323e2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:52.056173 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:52.061781 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e82aa1c-604f-4fcd-b4fc-62220c3323e2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:52.062273 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e82aa1c-604f-4fcd-b4fc-62220c3323e2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:52.062709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e82aa1c-604f-4fcd-b4fc-62220c3323e2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:52.063449 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e82aa1c-604f-4fcd-b4fc-62220c3323e2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:52.063934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e82aa1c-604f-4fcd-b4fc-62220c3323e2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:52.064355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e82aa1c-604f-4fcd-b4fc-62220c3323e2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:52.169543 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-14b5090a-8e96-4a53-8e6f-fdfc2a125d33 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:52.170334 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-14b5090a-8e96-4a53-8e6f-fdfc2a125d33 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:52.178252 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:52.182031 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14b5090a-8e96-4a53-8e6f-fdfc2a125d33 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:52.182568 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14b5090a-8e96-4a53-8e6f-fdfc2a125d33 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:52.183098 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14b5090a-8e96-4a53-8e6f-fdfc2a125d33 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:52.183894 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14b5090a-8e96-4a53-8e6f-fdfc2a125d33 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:52.184606 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14b5090a-8e96-4a53-8e6f-fdfc2a125d33 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:52.190363 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14b5090a-8e96-4a53-8e6f-fdfc2a125d33 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:52.349275 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-14b5090a-8e96-4a53-8e6f-fdfc2a125d33 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:52.359086 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-14b5090a-8e96-4a53-8e6f-fdfc2a125d33 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1463 microversion: 2.1 time: 0.193461 Sep 15 19:29:52.362268 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 207/412] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:52 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1463 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:52.412292 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bb0d876b-f89a-4c2f-8e21-7f11c1c1a5a7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:52.413801 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bb0d876b-f89a-4c2f-8e21-7f11c1c1a5a7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:52.424613 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb0d876b-f89a-4c2f-8e21-7f11c1c1a5a7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:52.425183 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb0d876b-f89a-4c2f-8e21-7f11c1c1a5a7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:52.425700 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb0d876b-f89a-4c2f-8e21-7f11c1c1a5a7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:52.428470 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb0d876b-f89a-4c2f-8e21-7f11c1c1a5a7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:52.428470 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb0d876b-f89a-4c2f-8e21-7f11c1c1a5a7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:52.428470 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb0d876b-f89a-4c2f-8e21-7f11c1c1a5a7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:52.462898 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bb0d876b-f89a-4c2f-8e21-7f11c1c1a5a7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:29:52.584457 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0e82aa1c-604f-4fcd-b4fc-62220c3323e2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:52.594679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0e82aa1c-604f-4fcd-b4fc-62220c3323e2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1724 microversion: 2.1 time: 0.546461 Sep 15 19:29:52.595383 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 206/413] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:52 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1724 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:52.648493 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:52.669372 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a1b4f098-5b43-4910-8dec-a0a18c27e4d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:52.669980 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a1b4f098-5b43-4910-8dec-a0a18c27e4d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:52.676323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1b4f098-5b43-4910-8dec-a0a18c27e4d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:52.676804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1b4f098-5b43-4910-8dec-a0a18c27e4d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:52.677237 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1b4f098-5b43-4910-8dec-a0a18c27e4d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:52.677931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1b4f098-5b43-4910-8dec-a0a18c27e4d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:52.678385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1b4f098-5b43-4910-8dec-a0a18c27e4d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:52.678814 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1b4f098-5b43-4910-8dec-a0a18c27e4d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:52.768828 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a1b4f098-5b43-4910-8dec-a0a18c27e4d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:52.777611 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a1b4f098-5b43-4910-8dec-a0a18c27e4d1 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1271 microversion: 2.1 time: 0.112139 Sep 15 19:29:52.778211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 207/414] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:52 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:52.837822 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bb0d876b-f89a-4c2f-8e21-7f11c1c1a5a7 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 204 len: 0 microversion: 2.1 time: 0.429159 Sep 15 19:29:52.838829 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 208/415] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:29:52 2022] DELETE /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 19:29:52.849515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-99cf6110-8542-4dd8-bc27-bf7027ff8153 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:52.850146 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-99cf6110-8542-4dd8-bc27-bf7027ff8153 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:52.857435 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99cf6110-8542-4dd8-bc27-bf7027ff8153 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:52.857888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99cf6110-8542-4dd8-bc27-bf7027ff8153 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:52.858331 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99cf6110-8542-4dd8-bc27-bf7027ff8153 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:52.859295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99cf6110-8542-4dd8-bc27-bf7027ff8153 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:52.859512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99cf6110-8542-4dd8-bc27-bf7027ff8153 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:52.859961 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99cf6110-8542-4dd8-bc27-bf7027ff8153 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:52.879291 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:53.051917 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-99cf6110-8542-4dd8-bc27-bf7027ff8153 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:53.060894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-99cf6110-8542-4dd8-bc27-bf7027ff8153 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1469 microversion: 2.1 time: 0.217520 Sep 15 19:29:53.061849 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 208/416] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:52 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:53.621908 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-82e35f97-eb9f-4f7d-bd6c-d96d6a5f2217 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:53.622536 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-82e35f97-eb9f-4f7d-bd6c-d96d6a5f2217 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:53.629819 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82e35f97-eb9f-4f7d-bd6c-d96d6a5f2217 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:53.630311 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82e35f97-eb9f-4f7d-bd6c-d96d6a5f2217 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:53.630785 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82e35f97-eb9f-4f7d-bd6c-d96d6a5f2217 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:53.631493 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82e35f97-eb9f-4f7d-bd6c-d96d6a5f2217 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:53.631993 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82e35f97-eb9f-4f7d-bd6c-d96d6a5f2217 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:53.633065 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82e35f97-eb9f-4f7d-bd6c-d96d6a5f2217 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:53.764357 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-82e35f97-eb9f-4f7d-bd6c-d96d6a5f2217 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:53.772941 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-82e35f97-eb9f-4f7d-bd6c-d96d6a5f2217 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1724 microversion: 2.1 time: 0.156190 Sep 15 19:29:53.773559 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 209/417] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:53 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:53.803618 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3d84a7d9-6bb3-40da-8e2a-b82be6cf59f4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:53.804848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3d84a7d9-6bb3-40da-8e2a-b82be6cf59f4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:53.811151 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3d84a7d9-6bb3-40da-8e2a-b82be6cf59f4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:53.811620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3d84a7d9-6bb3-40da-8e2a-b82be6cf59f4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:53.812129 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3d84a7d9-6bb3-40da-8e2a-b82be6cf59f4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:53.812810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3d84a7d9-6bb3-40da-8e2a-b82be6cf59f4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:53.813259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3d84a7d9-6bb3-40da-8e2a-b82be6cf59f4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:53.813676 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3d84a7d9-6bb3-40da-8e2a-b82be6cf59f4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:53.945229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3d84a7d9-6bb3-40da-8e2a-b82be6cf59f4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:53.954031 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3d84a7d9-6bb3-40da-8e2a-b82be6cf59f4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1313 microversion: 2.1 time: 0.154504 Sep 15 19:29:53.954609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 209/418] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:53 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:54.088981 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0fe44c4b-3fa7-486f-9b2d-da11803565f1 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:54.089591 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0fe44c4b-3fa7-486f-9b2d-da11803565f1 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:54.095552 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fe44c4b-3fa7-486f-9b2d-da11803565f1 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:54.096077 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fe44c4b-3fa7-486f-9b2d-da11803565f1 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:54.096540 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fe44c4b-3fa7-486f-9b2d-da11803565f1 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:54.097224 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fe44c4b-3fa7-486f-9b2d-da11803565f1 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:54.097674 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fe44c4b-3fa7-486f-9b2d-da11803565f1 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:54.098096 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fe44c4b-3fa7-486f-9b2d-da11803565f1 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:54.235202 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0fe44c4b-3fa7-486f-9b2d-da11803565f1 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:54.243138 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0fe44c4b-3fa7-486f-9b2d-da11803565f1 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1469 microversion: 2.1 time: 0.158593 Sep 15 19:29:54.243729 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 210/419] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:54 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:54.797173 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-259db188-eadf-416c-b4d6-3e18e552b259 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:54.797920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-259db188-eadf-416c-b4d6-3e18e552b259 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:54.804853 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-259db188-eadf-416c-b4d6-3e18e552b259 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:54.805716 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-259db188-eadf-416c-b4d6-3e18e552b259 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:54.806542 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-259db188-eadf-416c-b4d6-3e18e552b259 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:54.806850 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-259db188-eadf-416c-b4d6-3e18e552b259 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:54.807309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-259db188-eadf-416c-b4d6-3e18e552b259 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:54.807735 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-259db188-eadf-416c-b4d6-3e18e552b259 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:54.976753 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e71d3591-ac42-4ca9-ab4b-c36fc48f6137 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:54.977477 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e71d3591-ac42-4ca9-ab4b-c36fc48f6137 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:54.984758 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e71d3591-ac42-4ca9-ab4b-c36fc48f6137 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:54.985238 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e71d3591-ac42-4ca9-ab4b-c36fc48f6137 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:54.985667 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e71d3591-ac42-4ca9-ab4b-c36fc48f6137 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:54.986361 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e71d3591-ac42-4ca9-ab4b-c36fc48f6137 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:54.986809 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e71d3591-ac42-4ca9-ab4b-c36fc48f6137 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:54.987228 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e71d3591-ac42-4ca9-ab4b-c36fc48f6137 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:55.125357 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e71d3591-ac42-4ca9-ab4b-c36fc48f6137 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:55.134256 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e71d3591-ac42-4ca9-ab4b-c36fc48f6137 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1313 microversion: 2.1 time: 0.161294 Sep 15 19:29:55.134910 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 211/420] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:54 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:55.169107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-259db188-eadf-416c-b4d6-3e18e552b259 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:55.177822 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-259db188-eadf-416c-b4d6-3e18e552b259 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1724 microversion: 2.1 time: 0.384689 Sep 15 19:29:55.178489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 210/421] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:54 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1724 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:55.266354 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cbaa9881-29db-4bd4-9dad-e6e79af67677 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:55.267004 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cbaa9881-29db-4bd4-9dad-e6e79af67677 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:55.273255 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbaa9881-29db-4bd4-9dad-e6e79af67677 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:55.273735 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbaa9881-29db-4bd4-9dad-e6e79af67677 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:55.274170 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbaa9881-29db-4bd4-9dad-e6e79af67677 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:55.274914 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbaa9881-29db-4bd4-9dad-e6e79af67677 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:55.275361 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbaa9881-29db-4bd4-9dad-e6e79af67677 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:55.275805 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbaa9881-29db-4bd4-9dad-e6e79af67677 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:55.461841 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-cbaa9881-29db-4bd4-9dad-e6e79af67677 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:55.469777 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cbaa9881-29db-4bd4-9dad-e6e79af67677 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1469 microversion: 2.1 time: 0.207497 Sep 15 19:29:55.471743 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 212/422] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:55 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:55.540616 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-11ea4660-60e3-46cc-b05f-f0e3e7a4dc3d req-ff3d9f39-3836-4751-ba2e-97b92242b232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccb68e4f-daac-4a09-962e-7078b5cf4872", "tag": "541a0be0-658c-472a-a977-48f9872ca497"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:55.551675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-11ea4660-60e3-46cc-b05f-f0e3e7a4dc3d req-ff3d9f39-3836-4751-ba2e-97b92242b232 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:55.552403 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-11ea4660-60e3-46cc-b05f-f0e3e7a4dc3d req-ff3d9f39-3836-4751-ba2e-97b92242b232 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:55.552569 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-11ea4660-60e3-46cc-b05f-f0e3e7a4dc3d req-ff3d9f39-3836-4751-ba2e-97b92242b232 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:55.566743 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-11ea4660-60e3-46cc-b05f-f0e3e7a4dc3d req-ff3d9f39-3836-4751-ba2e-97b92242b232 service nova] Creating event network-changed:541a0be0-658c-472a-a977-48f9872ca497 for instance ccb68e4f-daac-4a09-962e-7078b5cf4872 on hv-cinder-84984 Sep 15 19:29:55.572214 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-11ea4660-60e3-46cc-b05f-f0e3e7a4dc3d req-ff3d9f39-3836-4751-ba2e-97b92242b232 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036062 Sep 15 19:29:55.575987 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 211/423] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:56.157836 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-56aa6e11-a080-4e6b-9b2d-f18b9e576280 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:56.158512 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-56aa6e11-a080-4e6b-9b2d-f18b9e576280 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:56.165248 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56aa6e11-a080-4e6b-9b2d-f18b9e576280 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:56.165771 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56aa6e11-a080-4e6b-9b2d-f18b9e576280 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:56.166206 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56aa6e11-a080-4e6b-9b2d-f18b9e576280 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:56.166929 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56aa6e11-a080-4e6b-9b2d-f18b9e576280 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:56.167376 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56aa6e11-a080-4e6b-9b2d-f18b9e576280 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:56.167832 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56aa6e11-a080-4e6b-9b2d-f18b9e576280 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:56.203465 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-44a32484-34d6-40d7-a8d8-cdd2777f7539 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:56.205114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-44a32484-34d6-40d7-a8d8-cdd2777f7539 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:56.213560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44a32484-34d6-40d7-a8d8-cdd2777f7539 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:56.214089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44a32484-34d6-40d7-a8d8-cdd2777f7539 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:56.214479 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44a32484-34d6-40d7-a8d8-cdd2777f7539 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:56.215182 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44a32484-34d6-40d7-a8d8-cdd2777f7539 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:56.215660 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44a32484-34d6-40d7-a8d8-cdd2777f7539 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:56.216092 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44a32484-34d6-40d7-a8d8-cdd2777f7539 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:56.317316 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-56aa6e11-a080-4e6b-9b2d-f18b9e576280 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:56.326213 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-56aa6e11-a080-4e6b-9b2d-f18b9e576280 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1313 microversion: 2.1 time: 0.171804 Sep 15 19:29:56.329154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 213/424] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:56 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:56.354111 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-44a32484-34d6-40d7-a8d8-cdd2777f7539 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:56.362468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-44a32484-34d6-40d7-a8d8-cdd2777f7539 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1724 microversion: 2.1 time: 0.164118 Sep 15 19:29:56.363039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 212/425] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:56 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:56.496825 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:56.497440 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:56.503936 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:56.504424 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:56.504864 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:56.505560 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:56.506014 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:56.506437 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:56.540521 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:56.541009 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:56.541445 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:56.541891 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lazy-loading 'fault' on Instance uuid bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:29:56.586844 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:56.600639 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02166f7d-57d7-4e9f-a1cf-5ef0666898cd tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1304 microversion: 2.1 time: 0.107597 Sep 15 19:29:56.601237 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 214/426] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:56 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:57.349844 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-782a4982-b3a3-4cd1-99cd-e2d1cd52af98 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:57.350464 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-782a4982-b3a3-4cd1-99cd-e2d1cd52af98 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:57.359059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-782a4982-b3a3-4cd1-99cd-e2d1cd52af98 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:57.359552 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-782a4982-b3a3-4cd1-99cd-e2d1cd52af98 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:57.360052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-782a4982-b3a3-4cd1-99cd-e2d1cd52af98 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:57.360753 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-782a4982-b3a3-4cd1-99cd-e2d1cd52af98 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:57.361210 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-782a4982-b3a3-4cd1-99cd-e2d1cd52af98 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:57.361699 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-782a4982-b3a3-4cd1-99cd-e2d1cd52af98 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:57.387367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4f9dfb64-986a-463c-a40f-2fd75b61237b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:57.389626 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4f9dfb64-986a-463c-a40f-2fd75b61237b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:57.394752 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f9dfb64-986a-463c-a40f-2fd75b61237b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:57.395417 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f9dfb64-986a-463c-a40f-2fd75b61237b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:57.395417 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f9dfb64-986a-463c-a40f-2fd75b61237b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:57.396158 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f9dfb64-986a-463c-a40f-2fd75b61237b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:57.396618 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f9dfb64-986a-463c-a40f-2fd75b61237b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:57.397053 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f9dfb64-986a-463c-a40f-2fd75b61237b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:57.508651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-782a4982-b3a3-4cd1-99cd-e2d1cd52af98 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:57.516835 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-782a4982-b3a3-4cd1-99cd-e2d1cd52af98 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1313 microversion: 2.1 time: 0.170980 Sep 15 19:29:57.521035 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 213/427] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:57 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:57.538868 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4f9dfb64-986a-463c-a40f-2fd75b61237b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:57.547743 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4f9dfb64-986a-463c-a40f-2fd75b61237b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1724 microversion: 2.1 time: 0.164944 Sep 15 19:29:57.548382 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 215/428] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:57 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:57.594503 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-fee10cee-cd0c-4aa5-a831-fc38614280fd req-b4c4ab41-f9f4-409f-814b-f878240bb98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b", "name": "network-vif-deleted", "tag": "6363c3da-31b1-4c7f-be7c-41a310dc3789"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:29:57.604134 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-fee10cee-cd0c-4aa5-a831-fc38614280fd req-b4c4ab41-f9f4-409f-814b-f878240bb98d service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:57.604669 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-fee10cee-cd0c-4aa5-a831-fc38614280fd req-b4c4ab41-f9f4-409f-814b-f878240bb98d service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:57.605203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-fee10cee-cd0c-4aa5-a831-fc38614280fd req-b4c4ab41-f9f4-409f-814b-f878240bb98d service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:57.616579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-fee10cee-cd0c-4aa5-a831-fc38614280fd req-b4c4ab41-f9f4-409f-814b-f878240bb98d service nova] Creating event network-vif-deleted:6363c3da-31b1-4c7f-be7c-41a310dc3789 for instance bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b on hv-cinder-84984 Sep 15 19:29:57.622304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-fee10cee-cd0c-4aa5-a831-fc38614280fd req-b4c4ab41-f9f4-409f-814b-f878240bb98d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031489 Sep 15 19:29:57.623708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 214/429] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:29:57.625214 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:57.625840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:57.633436 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:57.633930 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:57.634383 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:57.635092 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:57.635550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:57.636012 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:57.668551 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:57.669043 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:57.669480 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:57.669922 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lazy-loading 'fault' on Instance uuid bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:29:57.712410 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:57.720545 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-631ac358-e727-4709-8b7c-69cccd268e18 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1304 microversion: 2.1 time: 0.099194 Sep 15 19:29:57.736385 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 216/430] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:57 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:58.541772 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-75ba54b9-b3ed-405a-8c80-b80b6f431a97 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:58.542585 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-75ba54b9-b3ed-405a-8c80-b80b6f431a97 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:58.548981 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75ba54b9-b3ed-405a-8c80-b80b6f431a97 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:58.549473 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75ba54b9-b3ed-405a-8c80-b80b6f431a97 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:58.549902 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75ba54b9-b3ed-405a-8c80-b80b6f431a97 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:58.550595 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75ba54b9-b3ed-405a-8c80-b80b6f431a97 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:58.551051 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75ba54b9-b3ed-405a-8c80-b80b6f431a97 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:58.551491 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75ba54b9-b3ed-405a-8c80-b80b6f431a97 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:58.572139 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0400460-651c-4497-808f-2f0ac8b05e16 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:58.573102 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a0400460-651c-4497-808f-2f0ac8b05e16 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:58.579784 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0400460-651c-4497-808f-2f0ac8b05e16 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:58.580651 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0400460-651c-4497-808f-2f0ac8b05e16 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:58.581104 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0400460-651c-4497-808f-2f0ac8b05e16 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:58.581816 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0400460-651c-4497-808f-2f0ac8b05e16 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:58.582304 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0400460-651c-4497-808f-2f0ac8b05e16 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:58.582738 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0400460-651c-4497-808f-2f0ac8b05e16 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:58.699724 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-75ba54b9-b3ed-405a-8c80-b80b6f431a97 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:58.707996 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-75ba54b9-b3ed-405a-8c80-b80b6f431a97 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1313 microversion: 2.1 time: 0.171399 Sep 15 19:29:58.708584 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 215/431] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:58 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:58.720677 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0400460-651c-4497-808f-2f0ac8b05e16 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:58.730166 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0400460-651c-4497-808f-2f0ac8b05e16 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1724 microversion: 2.1 time: 0.162073 Sep 15 19:29:58.730735 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 217/432] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:58 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:58.744208 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:58.744804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:58.750771 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:58.751248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:58.751695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:58.752389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:58.752839 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:58.753254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:58.786708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:58.786708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:58.786708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:58.787157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lazy-loading 'fault' on Instance uuid bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:29:58.830760 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa5ec5bad5e41fcbdfd155bdcf6fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8e5530469c44cd8c4d962899f6ac5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:58.839166 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fc1a6d83-eb86-4520-bd7f-e4d138115e9c tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 200 len: 1304 microversion: 2.1 time: 0.099227 Sep 15 19:29:58.839761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 216/433] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:58 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:58.967555 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c042d1f9-f84a-4ec7-baae-504dfadc7e42 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:58.968190 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c042d1f9-f84a-4ec7-baae-504dfadc7e42 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:58.974490 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c042d1f9-f84a-4ec7-baae-504dfadc7e42 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:58.974971 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c042d1f9-f84a-4ec7-baae-504dfadc7e42 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:58.975587 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c042d1f9-f84a-4ec7-baae-504dfadc7e42 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:58.976341 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c042d1f9-f84a-4ec7-baae-504dfadc7e42 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:58.976788 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c042d1f9-f84a-4ec7-baae-504dfadc7e42 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:58.977207 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c042d1f9-f84a-4ec7-baae-504dfadc7e42 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:59.115683 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c042d1f9-f84a-4ec7-baae-504dfadc7e42 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:59.124270 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c042d1f9-f84a-4ec7-baae-504dfadc7e42 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1592 microversion: 2.1 time: 0.160528 Sep 15 19:29:59.124850 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 218/434] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:58 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1592 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:59.732187 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1ac0576a-ae80-4d87-86b5-6e65d8793b6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:59.732990 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1ac0576a-ae80-4d87-86b5-6e65d8793b6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:59.739742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1ac0576a-ae80-4d87-86b5-6e65d8793b6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:59.740225 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1ac0576a-ae80-4d87-86b5-6e65d8793b6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:59.740661 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1ac0576a-ae80-4d87-86b5-6e65d8793b6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:59.741405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1ac0576a-ae80-4d87-86b5-6e65d8793b6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:59.742432 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1ac0576a-ae80-4d87-86b5-6e65d8793b6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:59.742857 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1ac0576a-ae80-4d87-86b5-6e65d8793b6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:59.755275 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c4bb7e77-6229-46c9-818d-dd594a7640e8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:59.756673 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c4bb7e77-6229-46c9-818d-dd594a7640e8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:59.766025 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4bb7e77-6229-46c9-818d-dd594a7640e8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:59.767008 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4bb7e77-6229-46c9-818d-dd594a7640e8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:59.767695 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4bb7e77-6229-46c9-818d-dd594a7640e8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:59.768628 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4bb7e77-6229-46c9-818d-dd594a7640e8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:59.769263 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4bb7e77-6229-46c9-818d-dd594a7640e8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:59.770095 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4bb7e77-6229-46c9-818d-dd594a7640e8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:59.893662 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1ac0576a-ae80-4d87-86b5-6e65d8793b6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:59.902008 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1ac0576a-ae80-4d87-86b5-6e65d8793b6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1313 microversion: 2.1 time: 0.173716 Sep 15 19:29:59.902671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 217/435] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:59 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:29:59.907552 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4028e3d2-8ea5-4baa-8909-9eafadd44ea9 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:29:59.914235 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4028e3d2-8ea5-4baa-8909-9eafadd44ea9 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] [instance: bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:29:59.925333 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4028e3d2-8ea5-4baa-8909-9eafadd44ea9 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:59.926015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4028e3d2-8ea5-4baa-8909-9eafadd44ea9 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:59.926468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4028e3d2-8ea5-4baa-8909-9eafadd44ea9 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:59.927262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4028e3d2-8ea5-4baa-8909-9eafadd44ea9 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:29:59.927815 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4028e3d2-8ea5-4baa-8909-9eafadd44ea9 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:29:59.928244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4028e3d2-8ea5-4baa-8909-9eafadd44ea9 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:29:59.940073 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c4bb7e77-6229-46c9-818d-dd594a7640e8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:29:59.948421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-4028e3d2-8ea5-4baa-8909-9eafadd44ea9 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] HTTP exception thrown: Instance bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b could not be found. Sep 15 19:29:59.948778 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c4bb7e77-6229-46c9-818d-dd594a7640e8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1724 microversion: 2.1 time: 0.198409 Sep 15 19:29:59.949381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 219/436] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:59 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4028e3d2-8ea5-4baa-8909-9eafadd44ea9 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Request method failure captured: Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b HTTP/1.1 Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI30USMtVB0T7kMoX-OXGXSOh1jTlsKc3yvPy85FGZbasHRi8nnU91wLDEtPUU4VhtUgxIRbF8yB8_SLlcVzX-ngLUPqMDNkhm3KBNfKk5hj8B11ioM5bq-Cj69INCHzFjnl0p6XIswK9ebrYixAGGlENw_DHVQezjuT60dKEadxvoQM Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: ac8e5530469c44cd8c4d962899f6ac5b Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesNegativeTest-1961171498 Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:29:59.950091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:29:59.951493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ac8e5530469c44cd8c4d962899f6ac5b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ac8e5530469c44cd8c4d962899f6ac5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac8e5530469c44cd8c4d962899f6ac5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac8e5530469c44cd8c4d962899f6ac5b"}]}] Sep 15 19:29:59.951493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesNegativeTest-1961171498 Sep 15 19:29:59.951493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: ac8e5530469c44cd8c4d962899f6ac5b Sep 15 19:29:59.951493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesNegativeTest-1961171498 Sep 15 19:29:59.951493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesNegativeTest-1961171498-project Sep 15 19:29:59.951493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:29:59.951493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:29:59.951493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 7aa5ec5bad5e41fcbdfd155bdcf6fd8a Sep 15 19:29:59.951493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesNegativeTest-1961171498-project Sep 15 19:29:59.951493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:29:59.951493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b could not be found. Sep 15 19:29:59.951493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b'} Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b could not be found. Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:29:59.952718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b could not be found. Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b could not be found. Sep 15 19:29:59.954138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:29:59.955399 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4028e3d2-8ea5-4baa-8909-9eafadd44ea9 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] Returning 404 to user: Instance bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:29:59.955399 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4028e3d2-8ea5-4baa-8909-9eafadd44ea9 tempest-VolumesNegativeTest-1961171498 tempest-VolumesNegativeTest-1961171498-project] 10.222.0.18 "GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b" status: 404 len: 111 microversion: 2.1 time: 0.047552 Sep 15 19:29:59.955399 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 218/437] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:29:59 2022] GET /compute/v2.1/servers/bb1b5dc2-4c65-4f4c-a8fc-424660b3c76b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:30:00.928205 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f7f66b7-2080-4891-a944-53e8fbd077fd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:00.930346 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7f7f66b7-2080-4891-a944-53e8fbd077fd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:00.944024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f7f66b7-2080-4891-a944-53e8fbd077fd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:00.944751 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f7f66b7-2080-4891-a944-53e8fbd077fd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:00.946399 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f7f66b7-2080-4891-a944-53e8fbd077fd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:00.947907 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f7f66b7-2080-4891-a944-53e8fbd077fd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:00.955077 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f7f66b7-2080-4891-a944-53e8fbd077fd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:00.956159 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f7f66b7-2080-4891-a944-53e8fbd077fd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:00.975387 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-de3e1c04-e65a-4256-b699-1973a31e5bd3 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:00.977878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-de3e1c04-e65a-4256-b699-1973a31e5bd3 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:00.989607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de3e1c04-e65a-4256-b699-1973a31e5bd3 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:00.991936 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de3e1c04-e65a-4256-b699-1973a31e5bd3 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:00.993216 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de3e1c04-e65a-4256-b699-1973a31e5bd3 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:00.994876 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de3e1c04-e65a-4256-b699-1973a31e5bd3 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:00.997463 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de3e1c04-e65a-4256-b699-1973a31e5bd3 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:00.997952 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de3e1c04-e65a-4256-b699-1973a31e5bd3 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:01.156201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-de3e1c04-e65a-4256-b699-1973a31e5bd3 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:01.167026 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-de3e1c04-e65a-4256-b699-1973a31e5bd3 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1724 microversion: 2.1 time: 0.198285 Sep 15 19:30:01.167601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 219/438] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:00 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:30:01.212798 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7f7f66b7-2080-4891-a944-53e8fbd077fd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:01.222918 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7f7f66b7-2080-4891-a944-53e8fbd077fd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1313 microversion: 2.1 time: 0.298977 Sep 15 19:30:01.228253 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 220/439] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:00 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:01.629682 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-6a160523-2125-4e23-b0a8-4d7763d6d684 req-0431265f-ee4b-44f7-8cbf-9bf03e521ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdce58c-be13-4f4a-8a24-b3f3f002d77d", "tag": "1d0a2bca-ad01-4592-b8f5-ddac6af30dc4"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:01.639675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-6a160523-2125-4e23-b0a8-4d7763d6d684 req-0431265f-ee4b-44f7-8cbf-9bf03e521ab4 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:01.640203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-6a160523-2125-4e23-b0a8-4d7763d6d684 req-0431265f-ee4b-44f7-8cbf-9bf03e521ab4 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:01.640620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-6a160523-2125-4e23-b0a8-4d7763d6d684 req-0431265f-ee4b-44f7-8cbf-9bf03e521ab4 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:01.652306 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-6a160523-2125-4e23-b0a8-4d7763d6d684 req-0431265f-ee4b-44f7-8cbf-9bf03e521ab4 service nova] Creating event network-changed:1d0a2bca-ad01-4592-b8f5-ddac6af30dc4 for instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d on hv-cinder-84984 Sep 15 19:30:01.657386 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-6a160523-2125-4e23-b0a8-4d7763d6d684 req-0431265f-ee4b-44f7-8cbf-9bf03e521ab4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040951 Sep 15 19:30:01.658188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 220/440] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:02.192609 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03976761-95f6-4036-b908-b8d98f1f2eef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:02.193765 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-03976761-95f6-4036-b908-b8d98f1f2eef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:02.201441 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03976761-95f6-4036-b908-b8d98f1f2eef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:02.201936 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03976761-95f6-4036-b908-b8d98f1f2eef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:02.202373 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03976761-95f6-4036-b908-b8d98f1f2eef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:02.203082 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03976761-95f6-4036-b908-b8d98f1f2eef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:02.203538 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03976761-95f6-4036-b908-b8d98f1f2eef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:02.203996 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03976761-95f6-4036-b908-b8d98f1f2eef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:02.251311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a1544b43-98ec-4efc-b354-f206a7b5a78c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:02.252709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a1544b43-98ec-4efc-b354-f206a7b5a78c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:02.259974 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1544b43-98ec-4efc-b354-f206a7b5a78c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:02.260788 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1544b43-98ec-4efc-b354-f206a7b5a78c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:02.261464 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1544b43-98ec-4efc-b354-f206a7b5a78c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:02.262496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1544b43-98ec-4efc-b354-f206a7b5a78c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:02.263186 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1544b43-98ec-4efc-b354-f206a7b5a78c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:02.263851 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1544b43-98ec-4efc-b354-f206a7b5a78c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:02.418428 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-03976761-95f6-4036-b908-b8d98f1f2eef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:02.432119 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-03976761-95f6-4036-b908-b8d98f1f2eef tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1724 microversion: 2.1 time: 0.244379 Sep 15 19:30:02.433000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 221/441] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:02 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:02.498918 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a1544b43-98ec-4efc-b354-f206a7b5a78c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:02.509675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a1544b43-98ec-4efc-b354-f206a7b5a78c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1313 microversion: 2.1 time: 0.265487 Sep 15 19:30:02.510255 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 221/442] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:02 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:03.456701 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9692a207-d118-469e-b74a-f0fcd9179b4f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:03.457305 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9692a207-d118-469e-b74a-f0fcd9179b4f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:03.464381 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9692a207-d118-469e-b74a-f0fcd9179b4f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:03.464856 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9692a207-d118-469e-b74a-f0fcd9179b4f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:03.465285 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9692a207-d118-469e-b74a-f0fcd9179b4f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:03.465974 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9692a207-d118-469e-b74a-f0fcd9179b4f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:03.466421 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9692a207-d118-469e-b74a-f0fcd9179b4f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:03.466837 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9692a207-d118-469e-b74a-f0fcd9179b4f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:03.533375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fa527295-a574-4096-ad6a-ed2d6129b22c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:03.534120 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fa527295-a574-4096-ad6a-ed2d6129b22c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:03.542627 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa527295-a574-4096-ad6a-ed2d6129b22c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:03.543106 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa527295-a574-4096-ad6a-ed2d6129b22c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:03.543538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa527295-a574-4096-ad6a-ed2d6129b22c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:03.544299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa527295-a574-4096-ad6a-ed2d6129b22c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:03.544741 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa527295-a574-4096-ad6a-ed2d6129b22c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:03.545157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa527295-a574-4096-ad6a-ed2d6129b22c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:03.603430 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9692a207-d118-469e-b74a-f0fcd9179b4f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:03.611939 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9692a207-d118-469e-b74a-f0fcd9179b4f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1724 microversion: 2.1 time: 0.159071 Sep 15 19:30:03.612636 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 222/443] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:03 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:03.682001 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fa527295-a574-4096-ad6a-ed2d6129b22c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:03.689913 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fa527295-a574-4096-ad6a-ed2d6129b22c tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1313 microversion: 2.1 time: 0.160454 Sep 15 19:30:03.697824 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 222/444] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:03 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:30:04.575405 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f223f3f2-43ae-47af-b4fc-d711de4f3e29 req-e49223c8-cc41-4daf-ac02-89b52574e8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb68e4f-daac-4a09-962e-7078b5cf4872", "name": "network-vif-plugged", "status": "completed", "tag": "541a0be0-658c-472a-a977-48f9872ca497"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:04.586533 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f223f3f2-43ae-47af-b4fc-d711de4f3e29 req-e49223c8-cc41-4daf-ac02-89b52574e8f5 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:04.586774 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f223f3f2-43ae-47af-b4fc-d711de4f3e29 req-e49223c8-cc41-4daf-ac02-89b52574e8f5 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:04.587266 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f223f3f2-43ae-47af-b4fc-d711de4f3e29 req-e49223c8-cc41-4daf-ac02-89b52574e8f5 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:04.602245 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f223f3f2-43ae-47af-b4fc-d711de4f3e29 req-e49223c8-cc41-4daf-ac02-89b52574e8f5 service nova] Creating event network-vif-plugged:541a0be0-658c-472a-a977-48f9872ca497 for instance ccb68e4f-daac-4a09-962e-7078b5cf4872 on hv-cinder-84984 Sep 15 19:30:04.607639 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f223f3f2-43ae-47af-b4fc-d711de4f3e29 req-e49223c8-cc41-4daf-ac02-89b52574e8f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035944 Sep 15 19:30:04.610185 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 223/445] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:30:04.635393 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-73b6f15b-3202-4a7c-92de-01cd1fd318fb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:04.636045 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-73b6f15b-3202-4a7c-92de-01cd1fd318fb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:04.643003 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73b6f15b-3202-4a7c-92de-01cd1fd318fb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:04.643583 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73b6f15b-3202-4a7c-92de-01cd1fd318fb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:04.644052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73b6f15b-3202-4a7c-92de-01cd1fd318fb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:04.645058 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73b6f15b-3202-4a7c-92de-01cd1fd318fb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:04.645236 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73b6f15b-3202-4a7c-92de-01cd1fd318fb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:04.645728 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73b6f15b-3202-4a7c-92de-01cd1fd318fb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:04.714402 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72ab1d48-e75b-47f0-92cb-a7b6705f25dc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:04.715137 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-72ab1d48-e75b-47f0-92cb-a7b6705f25dc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:04.721386 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ab1d48-e75b-47f0-92cb-a7b6705f25dc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:04.721869 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ab1d48-e75b-47f0-92cb-a7b6705f25dc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:04.722304 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ab1d48-e75b-47f0-92cb-a7b6705f25dc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:04.723001 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ab1d48-e75b-47f0-92cb-a7b6705f25dc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:04.723450 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ab1d48-e75b-47f0-92cb-a7b6705f25dc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:04.723970 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ab1d48-e75b-47f0-92cb-a7b6705f25dc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:04.784459 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-73b6f15b-3202-4a7c-92de-01cd1fd318fb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:04.793927 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-73b6f15b-3202-4a7c-92de-01cd1fd318fb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1724 microversion: 2.1 time: 0.162532 Sep 15 19:30:04.794772 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 223/446] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:04 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:04.862807 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-72ab1d48-e75b-47f0-92cb-a7b6705f25dc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:04.870600 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-72ab1d48-e75b-47f0-92cb-a7b6705f25dc tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1313 microversion: 2.1 time: 0.160865 Sep 15 19:30:04.871193 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 224/447] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:04 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:30:05.817723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c71df207-4d5a-485a-a43b-7dcc48f255a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:05.818321 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c71df207-4d5a-485a-a43b-7dcc48f255a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:05.825141 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c71df207-4d5a-485a-a43b-7dcc48f255a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:05.825617 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c71df207-4d5a-485a-a43b-7dcc48f255a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:05.826053 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c71df207-4d5a-485a-a43b-7dcc48f255a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:05.826738 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c71df207-4d5a-485a-a43b-7dcc48f255a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:05.827191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c71df207-4d5a-485a-a43b-7dcc48f255a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:05.827615 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c71df207-4d5a-485a-a43b-7dcc48f255a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:05.893000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-055574f9-67c1-4946-9789-21fa16216d30 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:05.893739 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-055574f9-67c1-4946-9789-21fa16216d30 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:05.900148 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-055574f9-67c1-4946-9789-21fa16216d30 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:05.900654 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-055574f9-67c1-4946-9789-21fa16216d30 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:05.901084 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-055574f9-67c1-4946-9789-21fa16216d30 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:05.901775 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-055574f9-67c1-4946-9789-21fa16216d30 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:05.902224 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-055574f9-67c1-4946-9789-21fa16216d30 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:05.902638 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-055574f9-67c1-4946-9789-21fa16216d30 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:05.921940 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:30:05.967620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c71df207-4d5a-485a-a43b-7dcc48f255a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:05.977289 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c71df207-4d5a-485a-a43b-7dcc48f255a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1724 microversion: 2.1 time: 0.162819 Sep 15 19:30:05.991676 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 224/448] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:05 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:06.050483 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-055574f9-67c1-4946-9789-21fa16216d30 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:06.059965 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-055574f9-67c1-4946-9789-21fa16216d30 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1313 microversion: 2.1 time: 0.169712 Sep 15 19:30:06.059965 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 225/449] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:05 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:30:07.003858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-66e4c81c-aad6-48ba-8016-4ccb99be5169 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:07.004473 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-66e4c81c-aad6-48ba-8016-4ccb99be5169 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:07.012124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66e4c81c-aad6-48ba-8016-4ccb99be5169 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:07.013401 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66e4c81c-aad6-48ba-8016-4ccb99be5169 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:07.014027 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66e4c81c-aad6-48ba-8016-4ccb99be5169 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:07.014939 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66e4c81c-aad6-48ba-8016-4ccb99be5169 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:07.015564 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66e4c81c-aad6-48ba-8016-4ccb99be5169 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:07.018375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66e4c81c-aad6-48ba-8016-4ccb99be5169 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:07.083140 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d4040d62-5a2a-4f69-b103-c15708d4e5af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:07.091042 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d4040d62-5a2a-4f69-b103-c15708d4e5af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:07.091042 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4040d62-5a2a-4f69-b103-c15708d4e5af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:07.091696 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4040d62-5a2a-4f69-b103-c15708d4e5af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:07.092279 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4040d62-5a2a-4f69-b103-c15708d4e5af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:07.093242 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4040d62-5a2a-4f69-b103-c15708d4e5af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:07.093706 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4040d62-5a2a-4f69-b103-c15708d4e5af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:07.094317 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4040d62-5a2a-4f69-b103-c15708d4e5af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:07.182677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-66e4c81c-aad6-48ba-8016-4ccb99be5169 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:07.202909 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-66e4c81c-aad6-48ba-8016-4ccb99be5169 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1701 microversion: 2.1 time: 0.196080 Sep 15 19:30:07.202909 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 225/450] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:06 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1701 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:07.202909 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9a812001-66d4-42bc-9f1f-529618236fdd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-5768309"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:07.202909 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9a812001-66d4-42bc-9f1f-529618236fdd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:07.209326 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a812001-66d4-42bc-9f1f-529618236fdd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:07.209992 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a812001-66d4-42bc-9f1f-529618236fdd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:07.210663 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a812001-66d4-42bc-9f1f-529618236fdd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:07.211458 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a812001-66d4-42bc-9f1f-529618236fdd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:07.212141 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a812001-66d4-42bc-9f1f-529618236fdd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:07.212564 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a812001-66d4-42bc-9f1f-529618236fdd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:07.244227 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d4040d62-5a2a-4f69-b103-c15708d4e5af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:07.251999 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d4040d62-5a2a-4f69-b103-c15708d4e5af tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1313 microversion: 2.1 time: 0.174140 Sep 15 19:30:07.252576 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 226/451] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:07 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:30:07.257371 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5924720d-f332-4ec3-aac2-3bc7e5949944 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:07.262833 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:30:07.264508 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5924720d-f332-4ec3-aac2-3bc7e5949944 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:07.265199 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5924720d-f332-4ec3-aac2-3bc7e5949944 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:07.265856 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5924720d-f332-4ec3-aac2-3bc7e5949944 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:07.330224 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5924720d-f332-4ec3-aac2-3bc7e5949944 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Going to try to start instance {{(pid=121040) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 15 19:30:07.356684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.network.security_group_api [None req-9a812001-66d4-42bc-9f1f-529618236fdd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Adding security group 685f99b2-457d-475d-b5ae-8621eaa6e266 to port 1d0a2bca-ad01-4592-b8f5-ddac6af30dc4 Sep 15 19:30:07.632415 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5924720d-f332-4ec3-aac2-3bc7e5949944 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "POST /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/action" status: 202 len: 0 microversion: 2.1 time: 0.375338 Sep 15 19:30:07.632415 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 227/452] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:30:07 2022] POST /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:30:07.645798 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ddf80ec-c890-4952-bc0c-1d06fe601042 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:07.646557 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2ddf80ec-c890-4952-bc0c-1d06fe601042 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:07.654078 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ddf80ec-c890-4952-bc0c-1d06fe601042 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:07.654572 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ddf80ec-c890-4952-bc0c-1d06fe601042 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:07.655236 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ddf80ec-c890-4952-bc0c-1d06fe601042 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:07.656353 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ddf80ec-c890-4952-bc0c-1d06fe601042 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:07.656812 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ddf80ec-c890-4952-bc0c-1d06fe601042 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:07.657244 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ddf80ec-c890-4952-bc0c-1d06fe601042 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:07.795063 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2ddf80ec-c890-4952-bc0c-1d06fe601042 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:07.803397 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2ddf80ec-c890-4952-bc0c-1d06fe601042 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1710 microversion: 2.1 time: 0.167534 Sep 15 19:30:07.804005 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 228/453] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:07 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1710 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:07.912320 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9a812001-66d4-42bc-9f1f-529618236fdd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "POST /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/action" status: 202 len: 0 microversion: 2.1 time: 0.715209 Sep 15 19:30:07.913551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 226/454] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:30:07 2022] POST /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/action => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:30:07.922797 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33377145-4e57-491f-a362-cf43a7bdc6ad tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:07.923666 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-33377145-4e57-491f-a362-cf43a7bdc6ad tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:07.930124 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33377145-4e57-491f-a362-cf43a7bdc6ad tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:07.931197 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33377145-4e57-491f-a362-cf43a7bdc6ad tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:07.932199 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33377145-4e57-491f-a362-cf43a7bdc6ad tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:07.932924 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33377145-4e57-491f-a362-cf43a7bdc6ad tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:07.933382 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33377145-4e57-491f-a362-cf43a7bdc6ad tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:07.933808 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33377145-4e57-491f-a362-cf43a7bdc6ad tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:07.948185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-08b5e53f-a901-450f-a3c4-3f532adda815 req-8e60551b-53d9-4bde-8008-b6581c79ca1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdce58c-be13-4f4a-8a24-b3f3f002d77d", "tag": "1d0a2bca-ad01-4592-b8f5-ddac6af30dc4"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:07.962660 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-08b5e53f-a901-450f-a3c4-3f532adda815 req-8e60551b-53d9-4bde-8008-b6581c79ca1e service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:07.963683 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-08b5e53f-a901-450f-a3c4-3f532adda815 req-8e60551b-53d9-4bde-8008-b6581c79ca1e service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:07.964375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-08b5e53f-a901-450f-a3c4-3f532adda815 req-8e60551b-53d9-4bde-8008-b6581c79ca1e service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:07.979080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-08b5e53f-a901-450f-a3c4-3f532adda815 req-8e60551b-53d9-4bde-8008-b6581c79ca1e service nova] Creating event network-changed:1d0a2bca-ad01-4592-b8f5-ddac6af30dc4 for instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d on hv-cinder-84984 Sep 15 19:30:07.987111 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-08b5e53f-a901-450f-a3c4-3f532adda815 req-8e60551b-53d9-4bde-8008-b6581c79ca1e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040832 Sep 15 19:30:07.988632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 227/455] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:08.091868 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-33377145-4e57-491f-a362-cf43a7bdc6ad tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:08.100297 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33377145-4e57-491f-a362-cf43a7bdc6ad tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1755 microversion: 2.1 time: 0.181680 Sep 15 19:30:08.101194 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 229/456] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:07 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:08.277584 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ad07e79a-1089-4599-8ae5-71b4d4fccabd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:08.279216 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ad07e79a-1089-4599-8ae5-71b4d4fccabd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:08.285540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad07e79a-1089-4599-8ae5-71b4d4fccabd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:08.286072 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad07e79a-1089-4599-8ae5-71b4d4fccabd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:08.286501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad07e79a-1089-4599-8ae5-71b4d4fccabd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:08.287198 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad07e79a-1089-4599-8ae5-71b4d4fccabd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:08.287684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad07e79a-1089-4599-8ae5-71b4d4fccabd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:08.288092 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad07e79a-1089-4599-8ae5-71b4d4fccabd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:08.307298 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:30:08.540785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ad07e79a-1089-4599-8ae5-71b4d4fccabd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:08.548737 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ad07e79a-1089-4599-8ae5-71b4d4fccabd tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1313 microversion: 2.1 time: 0.276369 Sep 15 19:30:08.549606 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 228/457] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:08 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:08.827626 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3c662907-a766-411c-a35e-4a51a40cf822 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:08.828781 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3c662907-a766-411c-a35e-4a51a40cf822 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:08.836176 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c662907-a766-411c-a35e-4a51a40cf822 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:08.839085 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c662907-a766-411c-a35e-4a51a40cf822 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:08.839085 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c662907-a766-411c-a35e-4a51a40cf822 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:08.839085 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c662907-a766-411c-a35e-4a51a40cf822 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:08.839085 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c662907-a766-411c-a35e-4a51a40cf822 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:08.839408 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c662907-a766-411c-a35e-4a51a40cf822 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:09.006655 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3c662907-a766-411c-a35e-4a51a40cf822 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:09.018718 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3c662907-a766-411c-a35e-4a51a40cf822 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1710 microversion: 2.1 time: 0.195802 Sep 15 19:30:09.019766 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 230/458] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:08 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1710 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:09.575186 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-28bf166b-a38a-4a79-af3f-9ce8381b51e7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:09.576000 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-28bf166b-a38a-4a79-af3f-9ce8381b51e7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:09.583433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28bf166b-a38a-4a79-af3f-9ce8381b51e7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:09.584045 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28bf166b-a38a-4a79-af3f-9ce8381b51e7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:09.584553 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28bf166b-a38a-4a79-af3f-9ce8381b51e7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:09.585367 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28bf166b-a38a-4a79-af3f-9ce8381b51e7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:09.585818 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28bf166b-a38a-4a79-af3f-9ce8381b51e7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:09.586961 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28bf166b-a38a-4a79-af3f-9ce8381b51e7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:09.755761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-28bf166b-a38a-4a79-af3f-9ce8381b51e7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:09.764653 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-28bf166b-a38a-4a79-af3f-9ce8381b51e7 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1498 microversion: 2.1 time: 0.193415 Sep 15 19:30:09.765222 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 229/459] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:09 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1498 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:10.044256 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5278e7c-1356-4c41-b2bf-dd26dc5ebb3f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:10.044943 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a5278e7c-1356-4c41-b2bf-dd26dc5ebb3f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:10.051831 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5278e7c-1356-4c41-b2bf-dd26dc5ebb3f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:10.052315 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5278e7c-1356-4c41-b2bf-dd26dc5ebb3f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:10.053191 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5278e7c-1356-4c41-b2bf-dd26dc5ebb3f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:10.053441 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5278e7c-1356-4c41-b2bf-dd26dc5ebb3f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:10.053891 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5278e7c-1356-4c41-b2bf-dd26dc5ebb3f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:10.054314 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5278e7c-1356-4c41-b2bf-dd26dc5ebb3f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:10.198415 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5278e7c-1356-4c41-b2bf-dd26dc5ebb3f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:10.207343 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a5278e7c-1356-4c41-b2bf-dd26dc5ebb3f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1710 microversion: 2.1 time: 0.167259 Sep 15 19:30:10.207987 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 231/460] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:10 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1710 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:10.948990 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-55d70c0a-9a6f-4419-8108-291ce2cdaf1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:10.949504 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-55d70c0a-9a6f-4419-8108-291ce2cdaf1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:10.951791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=86 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:30:10.956667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-55d70c0a-9a6f-4419-8108-291ce2cdaf1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:10.957156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-55d70c0a-9a6f-4419-8108-291ce2cdaf1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:10.957598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-55d70c0a-9a6f-4419-8108-291ce2cdaf1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:10.958301 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-55d70c0a-9a6f-4419-8108-291ce2cdaf1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:10.958920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-55d70c0a-9a6f-4419-8108-291ce2cdaf1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:10.959350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-55d70c0a-9a6f-4419-8108-291ce2cdaf1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:10.988719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-55d70c0a-9a6f-4419-8108-291ce2cdaf1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:30:11.230848 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-21e23467-859f-41c2-8e64-8964de63a8ee tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:11.231542 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-21e23467-859f-41c2-8e64-8964de63a8ee tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:11.240128 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21e23467-859f-41c2-8e64-8964de63a8ee tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:11.240722 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21e23467-859f-41c2-8e64-8964de63a8ee tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:11.241176 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21e23467-859f-41c2-8e64-8964de63a8ee tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:11.242216 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21e23467-859f-41c2-8e64-8964de63a8ee tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:11.242873 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21e23467-859f-41c2-8e64-8964de63a8ee tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:11.243305 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21e23467-859f-41c2-8e64-8964de63a8ee tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:11.323198 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-55d70c0a-9a6f-4419-8108-291ce2cdaf1d tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 204 len: 0 microversion: 2.1 time: 0.378380 Sep 15 19:30:11.324143 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 230/461] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:30:10 2022] DELETE /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 19:30:11.333796 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8d937a95-eecd-4f87-ad79-d9d562029ea4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:11.334509 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8d937a95-eecd-4f87-ad79-d9d562029ea4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:11.341940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8d937a95-eecd-4f87-ad79-d9d562029ea4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:11.347931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8d937a95-eecd-4f87-ad79-d9d562029ea4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:11.348912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8d937a95-eecd-4f87-ad79-d9d562029ea4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:11.349816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8d937a95-eecd-4f87-ad79-d9d562029ea4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:11.350465 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8d937a95-eecd-4f87-ad79-d9d562029ea4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:11.351148 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8d937a95-eecd-4f87-ad79-d9d562029ea4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:11.397498 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-21e23467-859f-41c2-8e64-8964de63a8ee tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:11.406474 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-21e23467-859f-41c2-8e64-8964de63a8ee tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1714 microversion: 2.1 time: 0.179961 Sep 15 19:30:11.407060 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 232/462] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:11 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1714 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:30:11.497935 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8d937a95-eecd-4f87-ad79-d9d562029ea4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:11.506164 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8d937a95-eecd-4f87-ad79-d9d562029ea4 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1504 microversion: 2.1 time: 0.176842 Sep 15 19:30:11.506743 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 231/463] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:11 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:30:12.531920 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-da01d57c-eb44-4de6-a8e3-bbefc4456d6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:12.533378 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-da01d57c-eb44-4de6-a8e3-bbefc4456d6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:12.540830 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da01d57c-eb44-4de6-a8e3-bbefc4456d6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:12.541316 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da01d57c-eb44-4de6-a8e3-bbefc4456d6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:12.541752 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da01d57c-eb44-4de6-a8e3-bbefc4456d6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:12.542542 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da01d57c-eb44-4de6-a8e3-bbefc4456d6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:12.547453 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da01d57c-eb44-4de6-a8e3-bbefc4456d6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:12.547453 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da01d57c-eb44-4de6-a8e3-bbefc4456d6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:12.689519 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-da01d57c-eb44-4de6-a8e3-bbefc4456d6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:12.697505 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-da01d57c-eb44-4de6-a8e3-bbefc4456d6e tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1504 microversion: 2.1 time: 0.171250 Sep 15 19:30:12.698390 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 233/464] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:12 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:13.605264 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-0df01be1-7917-45cc-88eb-6dc55dc2cce6 req-4ac38ab6-710e-4134-9f8e-723d5eb72190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb68e4f-daac-4a09-962e-7078b5cf4872", "name": "network-vif-deleted", "tag": "541a0be0-658c-472a-a977-48f9872ca497"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:13.627886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-0df01be1-7917-45cc-88eb-6dc55dc2cce6 req-4ac38ab6-710e-4134-9f8e-723d5eb72190 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:13.627886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-0df01be1-7917-45cc-88eb-6dc55dc2cce6 req-4ac38ab6-710e-4134-9f8e-723d5eb72190 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:13.627886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-0df01be1-7917-45cc-88eb-6dc55dc2cce6 req-4ac38ab6-710e-4134-9f8e-723d5eb72190 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:13.636174 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-0df01be1-7917-45cc-88eb-6dc55dc2cce6 req-4ac38ab6-710e-4134-9f8e-723d5eb72190 service nova] Creating event network-vif-deleted:541a0be0-658c-472a-a977-48f9872ca497 for instance ccb68e4f-daac-4a09-962e-7078b5cf4872 on hv-cinder-84984 Sep 15 19:30:13.641127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-0df01be1-7917-45cc-88eb-6dc55dc2cce6 req-4ac38ab6-710e-4134-9f8e-723d5eb72190 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040052 Sep 15 19:30:13.641738 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 232/465] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:30:13.720798 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3122a40e-aa18-461b-abd6-ac0046caf506 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:13.721421 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3122a40e-aa18-461b-abd6-ac0046caf506 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:13.729382 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3122a40e-aa18-461b-abd6-ac0046caf506 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:13.729868 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3122a40e-aa18-461b-abd6-ac0046caf506 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:13.730305 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3122a40e-aa18-461b-abd6-ac0046caf506 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:13.731008 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3122a40e-aa18-461b-abd6-ac0046caf506 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:13.731472 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3122a40e-aa18-461b-abd6-ac0046caf506 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:13.731912 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3122a40e-aa18-461b-abd6-ac0046caf506 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:13.794681 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3122a40e-aa18-461b-abd6-ac0046caf506 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:13.802585 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3122a40e-aa18-461b-abd6-ac0046caf506 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1462 microversion: 2.1 time: 0.085766 Sep 15 19:30:13.803158 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 234/466] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:13 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:14.828527 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:14.830021 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:14.839080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:14.840061 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:14.840494 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:14.841369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:14.841996 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:14.842570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:14.882392 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:14.883599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:14.884552 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:14.885002 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lazy-loading 'fault' on Instance uuid ccb68e4f-daac-4a09-962e-7078b5cf4872 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:30:14.937214 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de2f8a8c6644220b9e1ed37a48b7d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf90b9345ae84e26b58e9238da0dac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:14.946048 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-57ee0051-06df-4b28-a286-d8bfb6225793 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 200 len: 1303 microversion: 2.1 time: 0.122253 Sep 15 19:30:14.947046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 233/467] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:14 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:15.978339 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-94404df2-8549-4b5d-a348-939cdee21dd3 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:15.979834 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-94404df2-8549-4b5d-a348-939cdee21dd3 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] [instance: ccb68e4f-daac-4a09-962e-7078b5cf4872] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:15.988798 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94404df2-8549-4b5d-a348-939cdee21dd3 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:15.989572 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94404df2-8549-4b5d-a348-939cdee21dd3 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:15.990171 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94404df2-8549-4b5d-a348-939cdee21dd3 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:15.991044 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94404df2-8549-4b5d-a348-939cdee21dd3 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:15.991704 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94404df2-8549-4b5d-a348-939cdee21dd3 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:15.991954 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94404df2-8549-4b5d-a348-939cdee21dd3 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:16.006319 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-94404df2-8549-4b5d-a348-939cdee21dd3 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] HTTP exception thrown: Instance ccb68e4f-daac-4a09-962e-7078b5cf4872 could not be found. Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-94404df2-8549-4b5d-a348-939cdee21dd3 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Request method failure captured: Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 HTTP/1.1 Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Connection: close Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Host: 10.222.0.18 Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjI3zxI0PQwGz-H7mE6rTGpZpwDZEwdJFlwdXc7jtANP4wo9oIjmzbfVnHhobZCPkdo1T9LoTKnm3PsBhwdrNE42_92k2nf3ozqEWlxGYEbdccbU4brJxY7imnOxmYo1pHoy4jRzGcqUtDbP0R5aw6g7XEnwqXtHyhbd0FDNFws1gSMbw Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Id: cf90b9345ae84e26b58e9238da0dac2e Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesActionsTest-1580950199 Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Role: member,reader Sep 15 19:30:16.008335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Roles: member,reader Sep 15 19:30:16.009911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf90b9345ae84e26b58e9238da0dac2e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf90b9345ae84e26b58e9238da0dac2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf90b9345ae84e26b58e9238da0dac2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf90b9345ae84e26b58e9238da0dac2e"}]}] Sep 15 19:30:16.009911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-VolumesActionsTest-1580950199 Sep 15 19:30:16.009911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Id: cf90b9345ae84e26b58e9238da0dac2e Sep 15 19:30:16.009911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesActionsTest-1580950199 Sep 15 19:30:16.009911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User: tempest-VolumesActionsTest-1580950199-project Sep 15 19:30:16.009911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 15 19:30:16.009911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 15 19:30:16.009911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Id: 7de2f8a8c6644220b9e1ed37a48b7d9a Sep 15 19:30:16.009911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-VolumesActionsTest-1580950199-project Sep 15 19:30:16.009911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: method: > Sep 15 19:30:16.009911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: exception: Instance ccb68e4f-daac-4a09-962e-7078b5cf4872 could not be found. Sep 15 19:30:16.009911 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: action_args: {'id': 'ccb68e4f-daac-4a09-962e-7078b5cf4872'} Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccb68e4f-daac-4a09-962e-7078b5cf4872 could not be found. Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:30:16.010897 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccb68e4f-daac-4a09-962e-7078b5cf4872 could not be found. Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccb68e4f-daac-4a09-962e-7078b5cf4872 could not be found. Sep 15 19:30:16.012569 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:16.013789 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-94404df2-8549-4b5d-a348-939cdee21dd3 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] Returning 404 to user: Instance ccb68e4f-daac-4a09-962e-7078b5cf4872 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:30:16.013789 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-94404df2-8549-4b5d-a348-939cdee21dd3 tempest-VolumesActionsTest-1580950199 tempest-VolumesActionsTest-1580950199-project] 10.222.0.18 "GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872" status: 404 len: 111 microversion: 2.1 time: 0.036456 Sep 15 19:30:16.013789 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 235/468] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:15 2022] GET /compute/v2.1/servers/ccb68e4f-daac-4a09-962e-7078b5cf4872 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:30:20.538128 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-487d3f3b-1724-4e67-818e-e7ef745c5a3a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:20.538726 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-487d3f3b-1724-4e67-818e-e7ef745c5a3a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:20.545200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-487d3f3b-1724-4e67-818e-e7ef745c5a3a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:20.545680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-487d3f3b-1724-4e67-818e-e7ef745c5a3a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:20.546112 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-487d3f3b-1724-4e67-818e-e7ef745c5a3a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:20.546804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-487d3f3b-1724-4e67-818e-e7ef745c5a3a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:20.547254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-487d3f3b-1724-4e67-818e-e7ef745c5a3a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:20.547697 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-487d3f3b-1724-4e67-818e-e7ef745c5a3a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:20.576566 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-487d3f3b-1724-4e67-818e-e7ef745c5a3a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f/ips" status: 200 len: 149 microversion: 2.1 time: 0.042213 Sep 15 19:30:20.577886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 234/469] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 15 19:30:20 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:20.590887 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-74c84427-9c14-46ad-9bdf-16fb11efe5cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "587d0a48-7e8f-4c25-a578-122ae49c3091"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:20.593879 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-74c84427-9c14-46ad-9bdf-16fb11efe5cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:20.601362 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74c84427-9c14-46ad-9bdf-16fb11efe5cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:20.601931 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74c84427-9c14-46ad-9bdf-16fb11efe5cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:20.602440 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74c84427-9c14-46ad-9bdf-16fb11efe5cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:20.603218 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74c84427-9c14-46ad-9bdf-16fb11efe5cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:20.603770 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74c84427-9c14-46ad-9bdf-16fb11efe5cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:20.604267 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74c84427-9c14-46ad-9bdf-16fb11efe5cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:20.768187 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-74c84427-9c14-46ad-9bdf-16fb11efe5cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Invalid volume: volume 587d0a48-7e8f-4c25-a578-122ae49c3091 is already attached to instances: 3532b103-32ed-4f98-988c-acdaaca65fa8 Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-74c84427-9c14-46ad-9bdf-16fb11efe5cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f/os-volume_attachments HTTP/1.1 Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Connection: close Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Length: 74 Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Host: 10.222.0.18 Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Role: member,reader Sep 15 19:30:20.770154 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Roles: member,reader Sep 15 19:30:20.771791 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:30:20.771791 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:30:20.771791 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:30:20.771791 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:30:20.771791 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:30:20.771791 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 15 19:30:20.771791 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 15 19:30:20.771791 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:30:20.771791 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:30:20.771791 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Sep 15 19:30:20.771791 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: {"volumeAttachment": {"volumeId": "587d0a48-7e8f-4c25-a578-122ae49c3091"}} Sep 15 19:30:20.771791 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: method: > Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: exception: Invalid volume: volume 587d0a48-7e8f-4c25-a578-122ae49c3091 is already attached to instances: 3532b103-32ed-4f98-988c-acdaaca65fa8 Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: action_args: {'server_id': '8c6cfa71-df2d-4e56-ba89-35f6153f327f', 'body': {'volumeAttachment': {'volumeId': '587d0a48-7e8f-4c25-a578-122ae49c3091'}}} Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 587d0a48-7e8f-4c25-a578-122ae49c3091 is already attached to instances: 3532b103-32ed-4f98-988c-acdaaca65fa8 Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:20.772687 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 587d0a48-7e8f-4c25-a578-122ae49c3091 is already attached to instances: 3532b103-32ed-4f98-988c-acdaaca65fa8 Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:30:20.776980 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:30:20.778401 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:30:20.778401 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:30:20.778401 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:30:20.778401 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 587d0a48-7e8f-4c25-a578-122ae49c3091 is already attached to instances: 3532b103-32ed-4f98-988c-acdaaca65fa8 Sep 15 19:30:20.778401 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:20.778401 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-74c84427-9c14-46ad-9bdf-16fb11efe5cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 400 to user: Invalid volume: volume 587d0a48-7e8f-4c25-a578-122ae49c3091 is already attached to instances: 3532b103-32ed-4f98-988c-acdaaca65fa8 {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:30:20.778401 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-74c84427-9c14-46ad-9bdf-16fb11efe5cc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "POST /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.187231 Sep 15 19:30:20.778401 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 236/470] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:30:20 2022] POST /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f/os-volume_attachments => generated 174 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 19:30:20.782275 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fc3d9d38-8656-4dc6-807c-2095af51b407 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:20.782810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fc3d9d38-8656-4dc6-807c-2095af51b407 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:20.790377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc3d9d38-8656-4dc6-807c-2095af51b407 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:20.790377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc3d9d38-8656-4dc6-807c-2095af51b407 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:20.790377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc3d9d38-8656-4dc6-807c-2095af51b407 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:20.790737 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc3d9d38-8656-4dc6-807c-2095af51b407 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:20.791241 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc3d9d38-8656-4dc6-807c-2095af51b407 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:20.791907 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc3d9d38-8656-4dc6-807c-2095af51b407 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:20.831613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fc3d9d38-8656-4dc6-807c-2095af51b407 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:30:21.449712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fc3d9d38-8656-4dc6-807c-2095af51b407 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 204 len: 0 microversion: 2.1 time: 0.671041 Sep 15 19:30:21.450527 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 235/471] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:30:20 2022] DELETE /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 0 bytes in 673 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 19:30:21.460458 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0892c45f-0c78-4d48-9591-b6bbabbbd481 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:21.462043 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0892c45f-0c78-4d48-9591-b6bbabbbd481 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:21.472135 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0892c45f-0c78-4d48-9591-b6bbabbbd481 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:21.472842 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0892c45f-0c78-4d48-9591-b6bbabbbd481 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:21.473452 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0892c45f-0c78-4d48-9591-b6bbabbbd481 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:21.474685 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0892c45f-0c78-4d48-9591-b6bbabbbd481 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:21.475321 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0892c45f-0c78-4d48-9591-b6bbabbbd481 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:21.475948 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0892c45f-0c78-4d48-9591-b6bbabbbd481 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:21.661283 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0892c45f-0c78-4d48-9591-b6bbabbbd481 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:21.670874 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0892c45f-0c78-4d48-9591-b6bbabbbd481 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1682 microversion: 2.1 time: 0.215836 Sep 15 19:30:21.671458 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 237/472] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:21 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:22.696717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1a7553a9-d4f1-4c34-b7dc-703d8bc9d794 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:22.697475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1a7553a9-d4f1-4c34-b7dc-703d8bc9d794 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:22.704093 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1a7553a9-d4f1-4c34-b7dc-703d8bc9d794 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:22.704574 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1a7553a9-d4f1-4c34-b7dc-703d8bc9d794 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:22.705004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1a7553a9-d4f1-4c34-b7dc-703d8bc9d794 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:22.705692 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1a7553a9-d4f1-4c34-b7dc-703d8bc9d794 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:22.706139 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1a7553a9-d4f1-4c34-b7dc-703d8bc9d794 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:22.706554 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1a7553a9-d4f1-4c34-b7dc-703d8bc9d794 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:23.002369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1a7553a9-d4f1-4c34-b7dc-703d8bc9d794 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:23.029296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1a7553a9-d4f1-4c34-b7dc-703d8bc9d794 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1682 microversion: 2.1 time: 0.336491 Sep 15 19:30:23.033341 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 236/473] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:22 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1682 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:24.059675 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ae544a97-1424-4452-8410-c54d3ce1f970 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:24.061543 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ae544a97-1424-4452-8410-c54d3ce1f970 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:24.083380 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae544a97-1424-4452-8410-c54d3ce1f970 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:24.086769 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae544a97-1424-4452-8410-c54d3ce1f970 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:24.094712 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae544a97-1424-4452-8410-c54d3ce1f970 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:24.094712 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae544a97-1424-4452-8410-c54d3ce1f970 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:24.094712 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae544a97-1424-4452-8410-c54d3ce1f970 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:24.094712 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae544a97-1424-4452-8410-c54d3ce1f970 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:24.317150 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae544a97-1424-4452-8410-c54d3ce1f970 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:24.331439 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ae544a97-1424-4452-8410-c54d3ce1f970 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1682 microversion: 2.1 time: 0.278280 Sep 15 19:30:24.332327 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 238/474] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:24 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1682 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:25.303589 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-3641e423-c207-4b34-b15b-6da537f4d18a req-3c7c40cb-5d14-4185-881f-30b1d4c28abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6cfa71-df2d-4e56-ba89-35f6153f327f", "name": "network-vif-deleted", "tag": "f848c54c-bc13-4277-851b-f4482d166911"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:25.340263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-3641e423-c207-4b34-b15b-6da537f4d18a req-3c7c40cb-5d14-4185-881f-30b1d4c28abb service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:25.342089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-3641e423-c207-4b34-b15b-6da537f4d18a req-3c7c40cb-5d14-4185-881f-30b1d4c28abb service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:25.342608 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-3641e423-c207-4b34-b15b-6da537f4d18a req-3c7c40cb-5d14-4185-881f-30b1d4c28abb service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:25.364160 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f3ae5c3d-d4a9-4f7f-b1c5-0a5b470befff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:25.364843 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f3ae5c3d-d4a9-4f7f-b1c5-0a5b470befff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:25.378837 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-3641e423-c207-4b34-b15b-6da537f4d18a req-3c7c40cb-5d14-4185-881f-30b1d4c28abb service nova] Creating event network-vif-deleted:f848c54c-bc13-4277-851b-f4482d166911 for instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f on hv-cinder-84984 Sep 15 19:30:25.384924 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3ae5c3d-d4a9-4f7f-b1c5-0a5b470befff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:25.386360 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3ae5c3d-d4a9-4f7f-b1c5-0a5b470befff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:25.388158 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3ae5c3d-d4a9-4f7f-b1c5-0a5b470befff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:25.389301 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3ae5c3d-d4a9-4f7f-b1c5-0a5b470befff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:25.391227 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3ae5c3d-d4a9-4f7f-b1c5-0a5b470befff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:25.391944 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3ae5c3d-d4a9-4f7f-b1c5-0a5b470befff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:25.392222 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-3641e423-c207-4b34-b15b-6da537f4d18a req-3c7c40cb-5d14-4185-881f-30b1d4c28abb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093254 Sep 15 19:30:25.393015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 237/475] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:25.582942 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f3ae5c3d-d4a9-4f7f-b1c5-0a5b470befff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:25.609453 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f3ae5c3d-d4a9-4f7f-b1c5-0a5b470befff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1614 microversion: 2.1 time: 0.251136 Sep 15 19:30:25.615853 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 239/476] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:25 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1614 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:30:26.638175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:26.639069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:26.652398 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:26.653197 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:26.653804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:26.656630 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:26.657329 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:26.658208 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:26.735098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:26.740955 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:26.741751 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:26.742409 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lazy-loading 'fault' on Instance uuid 8c6cfa71-df2d-4e56-ba89-35f6153f327f {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:30:26.832300 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:26.844121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e84df4be-f4dd-4a87-97d1-60d026e976a3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 200 len: 1332 microversion: 2.1 time: 0.210829 Sep 15 19:30:26.844717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 238/477] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:26 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 1332 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:27.871177 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9ee5f36-178b-4cbe-a6bc-06444996229a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:27.872309 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f9ee5f36-178b-4cbe-a6bc-06444996229a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:27.884464 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9ee5f36-178b-4cbe-a6bc-06444996229a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:27.888998 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9ee5f36-178b-4cbe-a6bc-06444996229a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:27.898361 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9ee5f36-178b-4cbe-a6bc-06444996229a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:27.901826 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9ee5f36-178b-4cbe-a6bc-06444996229a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:27.905359 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9ee5f36-178b-4cbe-a6bc-06444996229a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:27.920517 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9ee5f36-178b-4cbe-a6bc-06444996229a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:27.980111 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-f9ee5f36-178b-4cbe-a6bc-06444996229a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9ee5f36-178b-4cbe-a6bc-06444996229a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f HTTP/1.1 Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Connection: close Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Host: 10.222.0.18 Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Role: member,reader Sep 15 19:30:27.983061 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Roles: member,reader Sep 15 19:30:27.984684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:30:27.984684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:30:27.984684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:30:27.984684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:30:27.984684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:30:27.984684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 15 19:30:27.984684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 15 19:30:27.984684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:30:27.984684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:30:27.984684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: method: > Sep 15 19:30:27.984684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: exception: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:30:27.984684 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: action_args: {'id': '8c6cfa71-df2d-4e56-ba89-35f6153f327f'} Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:30:27.985550 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:30:27.987000 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 15 19:30:27.989585 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9ee5f36-178b-4cbe-a6bc-06444996229a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 404 to user: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:30:27.990845 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f9ee5f36-178b-4cbe-a6bc-06444996229a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 404 len: 111 microversion: 2.1 time: 0.125580 Sep 15 19:30:27.991925 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 240/478] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:27 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:30:28.013400 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d8ec171f-ff0a-433e-a467-f63dc340d3b3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '.version_select at 0x7f551eb65430>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:28.231105 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d8ec171f-ff0a-433e-a467-f63dc340d3b3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250587690" status: 202 len: 0 microversion: 2.1 time: 0.233183 Sep 15 19:30:28.237173 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 239/479] 10.222.0.18 () {58 vars in 1221 bytes} [Thu Sep 15 19:30:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250587690 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:30:28.609391 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6d7f1fe2-8909-4f56-8dc0-5a9df9d89cf8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:28.618653 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6d7f1fe2-8909-4f56-8dc0-5a9df9d89cf8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:28.669295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6d7f1fe2-8909-4f56-8dc0-5a9df9d89cf8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:28.677886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6d7f1fe2-8909-4f56-8dc0-5a9df9d89cf8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:28.677886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6d7f1fe2-8909-4f56-8dc0-5a9df9d89cf8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:28.677886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6d7f1fe2-8909-4f56-8dc0-5a9df9d89cf8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:28.685115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6d7f1fe2-8909-4f56-8dc0-5a9df9d89cf8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:28.685791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6d7f1fe2-8909-4f56-8dc0-5a9df9d89cf8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:28.981640 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d377d86-9094-4f2b-b716-6955148a81e6 tempest-TestVolumeBootPattern-514337844 tempest-TestVolumeBootPattern-514337844-project] Action: 'create', calling method: .version_select at 0x7f551ec74d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1611656672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZVzEJPW3MUUzg+pUoHBaUIQSdlK3Pj7fYLrHsOxg0VpAVGNYR0cYH9vgySn0t9np8W1UNfjndnhACjRdPK0I4gSQ9cx/0ld0ZGcvaffseuFv9VIq7O/JHbiWFhIqyG9A=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:29.004010 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-5d377d86-9094-4f2b-b716-6955148a81e6 tempest-TestVolumeBootPattern-514337844 tempest-TestVolumeBootPattern-514337844-project] Getting quotas for project 18b6ba58f0684cb699320fa8979047ae. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:30:29.009394 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-5d377d86-9094-4f2b-b716-6955148a81e6 tempest-TestVolumeBootPattern-514337844 tempest-TestVolumeBootPattern-514337844-project] Getting quotas for user e3624138edc34f89b9e92a97ac71faf4 and project 18b6ba58f0684cb699320fa8979047ae. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:30:29.091363 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6d7f1fe2-8909-4f56-8dc0-5a9df9d89cf8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "POST /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/action" status: 202 len: 0 microversion: 2.1 time: 0.486110 Sep 15 19:30:29.094125 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 240/480] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:30:28 2022] POST /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:30:29.108781 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-de1f586d-0037-4068-8826-b62fdcd415df tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:29.109901 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-de1f586d-0037-4068-8826-b62fdcd415df tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:29.126022 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de1f586d-0037-4068-8826-b62fdcd415df tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:29.126954 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de1f586d-0037-4068-8826-b62fdcd415df tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:29.127572 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de1f586d-0037-4068-8826-b62fdcd415df tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:29.132165 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de1f586d-0037-4068-8826-b62fdcd415df tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:29.133840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de1f586d-0037-4068-8826-b62fdcd415df tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:29.135021 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-de1f586d-0037-4068-8826-b62fdcd415df tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:29.170622 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d377d86-9094-4f2b-b716-6955148a81e6 tempest-TestVolumeBootPattern-514337844 tempest-TestVolumeBootPattern-514337844-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.571880 Sep 15 19:30:29.184546 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 241/481] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 15 19:30:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:29.338296 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4fcd8556-8552-4e02-b0b2-dea95edfb4bb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d52f6d82-8f48-4628-9d06-87743c7c0912"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:29.346413 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4fcd8556-8552-4e02-b0b2-dea95edfb4bb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:29.376037 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fcd8556-8552-4e02-b0b2-dea95edfb4bb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:29.376037 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fcd8556-8552-4e02-b0b2-dea95edfb4bb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:29.376280 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fcd8556-8552-4e02-b0b2-dea95edfb4bb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:29.377281 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fcd8556-8552-4e02-b0b2-dea95edfb4bb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:29.382844 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fcd8556-8552-4e02-b0b2-dea95edfb4bb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:29.383593 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fcd8556-8552-4e02-b0b2-dea95edfb4bb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:29.763686 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-de1f586d-0037-4068-8826-b62fdcd415df tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:29.778909 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-de1f586d-0037-4068-8826-b62fdcd415df tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1747 microversion: 2.1 time: 0.679471 Sep 15 19:30:29.783545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 241/482] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:29 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1747 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:30.659363 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:30:30.702527 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-29114ace-8bc0-48e5-99b4-c63f4cc20bf4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:30.706517 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-29114ace-8bc0-48e5-99b4-c63f4cc20bf4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:30.715269 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29114ace-8bc0-48e5-99b4-c63f4cc20bf4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:30.716063 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29114ace-8bc0-48e5-99b4-c63f4cc20bf4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:30.716719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29114ace-8bc0-48e5-99b4-c63f4cc20bf4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:30.717881 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29114ace-8bc0-48e5-99b4-c63f4cc20bf4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:30.718494 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29114ace-8bc0-48e5-99b4-c63f4cc20bf4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:30.719066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29114ace-8bc0-48e5-99b4-c63f4cc20bf4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:30.911703 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4fcd8556-8552-4e02-b0b2-dea95edfb4bb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "POST /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.589741 Sep 15 19:30:30.912615 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 242/483] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:30:29 2022] POST /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-volume_attachments => generated 194 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:30.924650 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c99fe1c7-f135-4588-a95d-8e088ae079dd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:30.933810 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c99fe1c7-f135-4588-a95d-8e088ae079dd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:30.970440 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c99fe1c7-f135-4588-a95d-8e088ae079dd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:30.985218 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c99fe1c7-f135-4588-a95d-8e088ae079dd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:30.988946 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c99fe1c7-f135-4588-a95d-8e088ae079dd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:31.000187 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c99fe1c7-f135-4588-a95d-8e088ae079dd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:31.000187 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c99fe1c7-f135-4588-a95d-8e088ae079dd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:31.000187 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c99fe1c7-f135-4588-a95d-8e088ae079dd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:31.030874 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:30:31.035585 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-29114ace-8bc0-48e5-99b4-c63f4cc20bf4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lazy-loading 'services' on Instance uuid 3532b103-32ed-4f98-988c-acdaaca65fa8 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:30:31.474097 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c99fe1c7-f135-4588-a95d-8e088ae079dd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:31.480777 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c99fe1c7-f135-4588-a95d-8e088ae079dd tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1752 microversion: 2.1 time: 0.566507 Sep 15 19:30:31.482916 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 243/484] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:30 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1752 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:31.678973 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-29114ace-8bc0-48e5-99b4-c63f4cc20bf4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments/587d0a48-7e8f-4c25-a578-122ae49c3091" status: 202 len: 0 microversion: 2.1 time: 0.982680 Sep 15 19:30:31.681975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 242/485] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 15 19:30:30 2022] DELETE /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments/587d0a48-7e8f-4c25-a578-122ae49c3091 => generated 0 bytes in 985 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:30:31.693289 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-32d97085-c978-461c-86f5-d7d1f50337c6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:31.698402 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-32d97085-c978-461c-86f5-d7d1f50337c6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:31.715699 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32d97085-c978-461c-86f5-d7d1f50337c6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:31.717983 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32d97085-c978-461c-86f5-d7d1f50337c6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:31.717983 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32d97085-c978-461c-86f5-d7d1f50337c6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:31.717983 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32d97085-c978-461c-86f5-d7d1f50337c6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:31.718703 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32d97085-c978-461c-86f5-d7d1f50337c6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:31.719400 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32d97085-c978-461c-86f5-d7d1f50337c6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:31.781037 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-32d97085-c978-461c-86f5-d7d1f50337c6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096488 Sep 15 19:30:31.782201 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 244/486] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:30:31 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:30:32.507316 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-603f74b5-7938-4c35-aee9-8db12156f392 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:32.509952 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-603f74b5-7938-4c35-aee9-8db12156f392 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:32.523466 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-603f74b5-7938-4c35-aee9-8db12156f392 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:32.524298 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-603f74b5-7938-4c35-aee9-8db12156f392 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:32.524912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-603f74b5-7938-4c35-aee9-8db12156f392 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:32.525956 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-603f74b5-7938-4c35-aee9-8db12156f392 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:32.526414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-603f74b5-7938-4c35-aee9-8db12156f392 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:32.530000 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-603f74b5-7938-4c35-aee9-8db12156f392 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:32.795546 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7cd2ff53-0317-489f-8509-d05a8ad9216b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:32.798477 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7cd2ff53-0317-489f-8509-d05a8ad9216b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:32.843749 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cd2ff53-0317-489f-8509-d05a8ad9216b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:32.845405 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cd2ff53-0317-489f-8509-d05a8ad9216b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:32.847122 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cd2ff53-0317-489f-8509-d05a8ad9216b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:32.848711 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cd2ff53-0317-489f-8509-d05a8ad9216b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:32.850449 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cd2ff53-0317-489f-8509-d05a8ad9216b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:32.854247 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cd2ff53-0317-489f-8509-d05a8ad9216b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:32.868792 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-603f74b5-7938-4c35-aee9-8db12156f392 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:32.881655 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-603f74b5-7938-4c35-aee9-8db12156f392 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1752 microversion: 2.1 time: 0.378854 Sep 15 19:30:32.888105 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 243/487] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:32 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1752 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:32.981804 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7cd2ff53-0317-489f-8509-d05a8ad9216b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190588 Sep 15 19:30:32.984263 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 245/488] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:30:32 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:33.914930 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-89e07e7b-9391-488f-9121-fd306cd2bbd8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:33.919480 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-89e07e7b-9391-488f-9121-fd306cd2bbd8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:33.945697 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89e07e7b-9391-488f-9121-fd306cd2bbd8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:33.946113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89e07e7b-9391-488f-9121-fd306cd2bbd8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:33.946558 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89e07e7b-9391-488f-9121-fd306cd2bbd8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:33.947273 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89e07e7b-9391-488f-9121-fd306cd2bbd8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:33.947824 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89e07e7b-9391-488f-9121-fd306cd2bbd8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:33.950039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89e07e7b-9391-488f-9121-fd306cd2bbd8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:33.996179 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2df560b3-4805-47d9-b655-33b4885116ac tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:33.998961 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2df560b3-4805-47d9-b655-33b4885116ac tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:34.011025 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2df560b3-4805-47d9-b655-33b4885116ac tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:34.012103 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2df560b3-4805-47d9-b655-33b4885116ac tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:34.012818 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2df560b3-4805-47d9-b655-33b4885116ac tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:34.013979 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2df560b3-4805-47d9-b655-33b4885116ac tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:34.014653 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2df560b3-4805-47d9-b655-33b4885116ac tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:34.017030 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2df560b3-4805-47d9-b655-33b4885116ac tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:34.074518 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2df560b3-4805-47d9-b655-33b4885116ac tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083689 Sep 15 19:30:34.077887 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 246/489] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:30:33 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:34.308416 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-89e07e7b-9391-488f-9121-fd306cd2bbd8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:34.318354 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-89e07e7b-9391-488f-9121-fd306cd2bbd8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1752 microversion: 2.1 time: 0.410521 Sep 15 19:30:34.323018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 244/490] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:33 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1752 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:35.088879 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d3e6fe9-d065-4956-8688-7594f34285c8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:35.091808 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3d3e6fe9-d065-4956-8688-7594f34285c8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:35.105007 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d3e6fe9-d065-4956-8688-7594f34285c8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:35.112844 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d3e6fe9-d065-4956-8688-7594f34285c8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:35.113579 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d3e6fe9-d065-4956-8688-7594f34285c8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:35.116874 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d3e6fe9-d065-4956-8688-7594f34285c8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:35.118424 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d3e6fe9-d065-4956-8688-7594f34285c8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:35.118868 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d3e6fe9-d065-4956-8688-7594f34285c8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:35.185956 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d3e6fe9-d065-4956-8688-7594f34285c8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100099 Sep 15 19:30:35.187019 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 247/491] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:30:35 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:35.348152 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ad8ff750-509a-4a83-a1e4-6e4b9f5d5a98 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:35.351036 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ad8ff750-509a-4a83-a1e4-6e4b9f5d5a98 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:35.359141 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad8ff750-509a-4a83-a1e4-6e4b9f5d5a98 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:35.360092 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad8ff750-509a-4a83-a1e4-6e4b9f5d5a98 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:35.364423 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad8ff750-509a-4a83-a1e4-6e4b9f5d5a98 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:35.364423 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad8ff750-509a-4a83-a1e4-6e4b9f5d5a98 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:35.364423 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad8ff750-509a-4a83-a1e4-6e4b9f5d5a98 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:35.364423 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad8ff750-509a-4a83-a1e4-6e4b9f5d5a98 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:35.577280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ad8ff750-509a-4a83-a1e4-6e4b9f5d5a98 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:35.613667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ad8ff750-509a-4a83-a1e4-6e4b9f5d5a98 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1752 microversion: 2.1 time: 0.271324 Sep 15 19:30:35.623789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 245/492] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:35 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1752 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:36.199613 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-63471589-bbcd-4128-9168-043606f1452e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:36.205610 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-63471589-bbcd-4128-9168-043606f1452e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:36.223125 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63471589-bbcd-4128-9168-043606f1452e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:36.223983 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63471589-bbcd-4128-9168-043606f1452e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:36.224581 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63471589-bbcd-4128-9168-043606f1452e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:36.225477 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63471589-bbcd-4128-9168-043606f1452e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:36.226039 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63471589-bbcd-4128-9168-043606f1452e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:36.226467 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63471589-bbcd-4128-9168-043606f1452e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:36.278595 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-63471589-bbcd-4128-9168-043606f1452e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083314 Sep 15 19:30:36.279183 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 248/493] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:30:36 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:36.646911 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7def1924-af92-424c-8540-a13631df7128 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:36.651004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7def1924-af92-424c-8540-a13631df7128 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:36.666538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7def1924-af92-424c-8540-a13631df7128 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:36.669085 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7def1924-af92-424c-8540-a13631df7128 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:36.672079 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7def1924-af92-424c-8540-a13631df7128 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:36.674292 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7def1924-af92-424c-8540-a13631df7128 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:36.675331 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7def1924-af92-424c-8540-a13631df7128 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:36.675988 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7def1924-af92-424c-8540-a13631df7128 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:36.980299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7def1924-af92-424c-8540-a13631df7128 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:36.999553 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7def1924-af92-424c-8540-a13631df7128 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1752 microversion: 2.1 time: 0.363631 Sep 15 19:30:37.003836 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 246/494] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:36 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1752 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:37.291949 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-058ddad3-1c9c-4bd7-8112-c3586edd77c2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:37.294100 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-058ddad3-1c9c-4bd7-8112-c3586edd77c2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:37.303003 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-058ddad3-1c9c-4bd7-8112-c3586edd77c2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:37.304308 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-058ddad3-1c9c-4bd7-8112-c3586edd77c2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:37.305371 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-058ddad3-1c9c-4bd7-8112-c3586edd77c2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:37.306224 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-058ddad3-1c9c-4bd7-8112-c3586edd77c2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:37.307226 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-058ddad3-1c9c-4bd7-8112-c3586edd77c2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:37.308072 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-058ddad3-1c9c-4bd7-8112-c3586edd77c2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:37.347313 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-058ddad3-1c9c-4bd7-8112-c3586edd77c2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059456 Sep 15 19:30:37.348318 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 249/495] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:30:37 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:38.037786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-46de4738-bca1-4e1d-80bf-ee9dbd7a67b1 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:38.040267 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-46de4738-bca1-4e1d-80bf-ee9dbd7a67b1 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:38.071052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46de4738-bca1-4e1d-80bf-ee9dbd7a67b1 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:38.084185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46de4738-bca1-4e1d-80bf-ee9dbd7a67b1 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:38.084185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46de4738-bca1-4e1d-80bf-ee9dbd7a67b1 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:38.084185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46de4738-bca1-4e1d-80bf-ee9dbd7a67b1 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:38.084185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46de4738-bca1-4e1d-80bf-ee9dbd7a67b1 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:38.084607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46de4738-bca1-4e1d-80bf-ee9dbd7a67b1 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:38.363462 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-551e4f61-969f-4f77-81a4-e3d53ee2c623 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:38.368052 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-551e4f61-969f-4f77-81a4-e3d53ee2c623 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:38.380375 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-551e4f61-969f-4f77-81a4-e3d53ee2c623 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:38.380982 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-551e4f61-969f-4f77-81a4-e3d53ee2c623 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:38.382031 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-551e4f61-969f-4f77-81a4-e3d53ee2c623 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:38.383788 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-551e4f61-969f-4f77-81a4-e3d53ee2c623 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:38.384496 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-551e4f61-969f-4f77-81a4-e3d53ee2c623 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:38.385163 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-551e4f61-969f-4f77-81a4-e3d53ee2c623 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:38.434189 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-551e4f61-969f-4f77-81a4-e3d53ee2c623 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075948 Sep 15 19:30:38.435746 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 250/496] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:30:38 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:38.497161 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-46de4738-bca1-4e1d-80bf-ee9dbd7a67b1 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:38.507463 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-46de4738-bca1-4e1d-80bf-ee9dbd7a67b1 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1752 microversion: 2.1 time: 0.476159 Sep 15 19:30:38.509310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 247/497] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:38 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1752 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:39.457004 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1ff53193-8f24-4faf-b618-56f82e74b1eb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:39.459787 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ff53193-8f24-4faf-b618-56f82e74b1eb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:39.465144 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:30:39.467416 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ff53193-8f24-4faf-b618-56f82e74b1eb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:39.468171 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ff53193-8f24-4faf-b618-56f82e74b1eb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:39.468875 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ff53193-8f24-4faf-b618-56f82e74b1eb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:39.469821 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ff53193-8f24-4faf-b618-56f82e74b1eb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:39.470386 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ff53193-8f24-4faf-b618-56f82e74b1eb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:39.470881 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ff53193-8f24-4faf-b618-56f82e74b1eb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:39.540666 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-066ab363-d418-4c00-b773-e8a693dc6c74 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:39.542821 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-066ab363-d418-4c00-b773-e8a693dc6c74 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:39.547953 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1ff53193-8f24-4faf-b618-56f82e74b1eb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094986 Sep 15 19:30:39.550969 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 251/498] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:30:39 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:39.552741 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-066ab363-d418-4c00-b773-e8a693dc6c74 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:39.553454 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-066ab363-d418-4c00-b773-e8a693dc6c74 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:39.554186 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-066ab363-d418-4c00-b773-e8a693dc6c74 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:39.555852 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-066ab363-d418-4c00-b773-e8a693dc6c74 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:39.556529 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-066ab363-d418-4c00-b773-e8a693dc6c74 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:39.557449 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-066ab363-d418-4c00-b773-e8a693dc6c74 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:39.801543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-066ab363-d418-4c00-b773-e8a693dc6c74 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:39.812812 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-066ab363-d418-4c00-b773-e8a693dc6c74 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1752 microversion: 2.1 time: 0.278607 Sep 15 19:30:39.814351 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 248/499] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:39 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1752 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:40.200536 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc29e4f1-e17c-41d1-8062-6d4f68ec7458 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:40.204461 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bc29e4f1-e17c-41d1-8062-6d4f68ec7458 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:40.208108 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:30:40.215933 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc29e4f1-e17c-41d1-8062-6d4f68ec7458 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:40.216680 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc29e4f1-e17c-41d1-8062-6d4f68ec7458 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:40.217543 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc29e4f1-e17c-41d1-8062-6d4f68ec7458 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:40.218371 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc29e4f1-e17c-41d1-8062-6d4f68ec7458 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:40.219028 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc29e4f1-e17c-41d1-8062-6d4f68ec7458 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:40.219456 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc29e4f1-e17c-41d1-8062-6d4f68ec7458 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:40.247242 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-bc29e4f1-e17c-41d1-8062-6d4f68ec7458 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lazy-loading 'flavor' on Instance uuid 212105c1-8435-430c-9ffa-72e8a6bd2426 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:30:40.564797 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-91099904-bc53-4745-b151-37ab01e85196 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:40.568116 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-91099904-bc53-4745-b151-37ab01e85196 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:40.578888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91099904-bc53-4745-b151-37ab01e85196 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:40.580322 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91099904-bc53-4745-b151-37ab01e85196 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:40.580984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91099904-bc53-4745-b151-37ab01e85196 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:40.581797 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91099904-bc53-4745-b151-37ab01e85196 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:40.582266 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91099904-bc53-4745-b151-37ab01e85196 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:40.583032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91099904-bc53-4745-b151-37ab01e85196 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:40.646177 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-91099904-bc53-4745-b151-37ab01e85196 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087368 Sep 15 19:30:40.647294 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 249/500] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:30:40 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:30:40.840484 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a0a7ea46-b9ba-48c5-b806-4ab2e09bb805 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:40.840974 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a0a7ea46-b9ba-48c5-b806-4ab2e09bb805 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:40.849562 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc29e4f1-e17c-41d1-8062-6d4f68ec7458 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "POST /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/action" status: 200 len: 32 microversion: 2.1 time: 0.653532 Sep 15 19:30:40.855205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0a7ea46-b9ba-48c5-b806-4ab2e09bb805 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:40.860455 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 252/501] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:30:40 2022] POST /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/action => generated 32 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 19:30:40.861063 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0a7ea46-b9ba-48c5-b806-4ab2e09bb805 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:40.861795 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0a7ea46-b9ba-48c5-b806-4ab2e09bb805 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:40.866929 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0a7ea46-b9ba-48c5-b806-4ab2e09bb805 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:40.868476 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0a7ea46-b9ba-48c5-b806-4ab2e09bb805 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:40.870074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0a7ea46-b9ba-48c5-b806-4ab2e09bb805 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:40.874365 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03347b41-618b-4a00-9507-71574fd72a6e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:40.876078 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-03347b41-618b-4a00-9507-71574fd72a6e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:40.889958 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03347b41-618b-4a00-9507-71574fd72a6e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:40.891454 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03347b41-618b-4a00-9507-71574fd72a6e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:40.892610 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03347b41-618b-4a00-9507-71574fd72a6e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:40.894815 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03347b41-618b-4a00-9507-71574fd72a6e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:40.895970 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03347b41-618b-4a00-9507-71574fd72a6e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:40.897128 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03347b41-618b-4a00-9507-71574fd72a6e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:41.287345 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-03347b41-618b-4a00-9507-71574fd72a6e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:41.330643 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-03347b41-618b-4a00-9507-71574fd72a6e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.465732 Sep 15 19:30:41.335742 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 253/502] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:40 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:41.380326 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a0a7ea46-b9ba-48c5-b806-4ab2e09bb805 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:41.389757 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a0a7ea46-b9ba-48c5-b806-4ab2e09bb805 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1752 microversion: 2.1 time: 0.553211 Sep 15 19:30:41.405982 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 250/503] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:40 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1752 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:41.660358 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a35dd6c1-5526-4b87-95a5-35ceeea8e18a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:41.662764 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a35dd6c1-5526-4b87-95a5-35ceeea8e18a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:41.679612 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a35dd6c1-5526-4b87-95a5-35ceeea8e18a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:41.680660 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a35dd6c1-5526-4b87-95a5-35ceeea8e18a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:41.681302 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a35dd6c1-5526-4b87-95a5-35ceeea8e18a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:41.682533 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a35dd6c1-5526-4b87-95a5-35ceeea8e18a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:41.683177 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a35dd6c1-5526-4b87-95a5-35ceeea8e18a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:41.683787 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a35dd6c1-5526-4b87-95a5-35ceeea8e18a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:41.749563 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a35dd6c1-5526-4b87-95a5-35ceeea8e18a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093676 Sep 15 19:30:41.750415 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 254/504] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:30:41 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 19:30:41.885505 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ff2d80b5-c3af-492c-a843-322a26158555 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:41.886420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ff2d80b5-c3af-492c-a843-322a26158555 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:41.897277 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:30:41.900780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff2d80b5-c3af-492c-a843-322a26158555 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:41.901634 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff2d80b5-c3af-492c-a843-322a26158555 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:41.902387 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff2d80b5-c3af-492c-a843-322a26158555 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:41.904064 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff2d80b5-c3af-492c-a843-322a26158555 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:41.905275 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff2d80b5-c3af-492c-a843-322a26158555 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:41.906358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff2d80b5-c3af-492c-a843-322a26158555 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:41.996690 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ff2d80b5-c3af-492c-a843-322a26158555 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:30:42.373527 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8615a95f-6c0e-40cd-a733-01a3f0a54a90 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:42.374328 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8615a95f-6c0e-40cd-a733-01a3f0a54a90 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:42.381784 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8615a95f-6c0e-40cd-a733-01a3f0a54a90 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:42.382271 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8615a95f-6c0e-40cd-a733-01a3f0a54a90 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:42.382708 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8615a95f-6c0e-40cd-a733-01a3f0a54a90 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:42.383998 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8615a95f-6c0e-40cd-a733-01a3f0a54a90 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:42.384488 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8615a95f-6c0e-40cd-a733-01a3f0a54a90 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:42.384903 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8615a95f-6c0e-40cd-a733-01a3f0a54a90 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:42.569722 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8615a95f-6c0e-40cd-a733-01a3f0a54a90 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:42.569722 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8615a95f-6c0e-40cd-a733-01a3f0a54a90 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.190674 Sep 15 19:30:42.569722 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 255/505] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:42 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:42.569722 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a328536f-2535-40d9-a06f-4b92fccc3b26 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:42.571164 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a328536f-2535-40d9-a06f-4b92fccc3b26 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:42.575449 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a328536f-2535-40d9-a06f-4b92fccc3b26 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:42.576467 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a328536f-2535-40d9-a06f-4b92fccc3b26 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:42.576923 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a328536f-2535-40d9-a06f-4b92fccc3b26 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:42.577672 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a328536f-2535-40d9-a06f-4b92fccc3b26 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:42.578210 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a328536f-2535-40d9-a06f-4b92fccc3b26 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:42.578638 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a328536f-2535-40d9-a06f-4b92fccc3b26 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:42.667731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ff2d80b5-c3af-492c-a843-322a26158555 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 204 len: 0 microversion: 2.1 time: 0.749563 Sep 15 19:30:42.667731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 251/506] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:30:41 2022] DELETE /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 19:30:42.667731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2ae028a0-559d-420b-a660-04e477a8e3a7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:42.667731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2ae028a0-559d-420b-a660-04e477a8e3a7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:42.667731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ae028a0-559d-420b-a660-04e477a8e3a7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:42.668315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ae028a0-559d-420b-a660-04e477a8e3a7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:42.668315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ae028a0-559d-420b-a660-04e477a8e3a7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:42.668315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ae028a0-559d-420b-a660-04e477a8e3a7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:42.668315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ae028a0-559d-420b-a660-04e477a8e3a7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:42.668603 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ae028a0-559d-420b-a660-04e477a8e3a7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:42.908130 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2ae028a0-559d-420b-a660-04e477a8e3a7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:42.920778 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2ae028a0-559d-420b-a660-04e477a8e3a7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1681 microversion: 2.1 time: 0.287846 Sep 15 19:30:42.932069 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a328536f-2535-40d9-a06f-4b92fccc3b26 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:42.932583 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 252/507] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:42 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1681 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:42.939700 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:30:42.948552 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a328536f-2535-40d9-a06f-4b92fccc3b26 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1752 microversion: 2.1 time: 0.386211 Sep 15 19:30:42.949646 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 256/508] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:42 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1752 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:43.592019 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-06b1b917-e78a-4f5a-8361-dd1d55d1798d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:43.593147 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-06b1b917-e78a-4f5a-8361-dd1d55d1798d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:43.600288 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06b1b917-e78a-4f5a-8361-dd1d55d1798d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:43.603601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06b1b917-e78a-4f5a-8361-dd1d55d1798d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:43.603601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06b1b917-e78a-4f5a-8361-dd1d55d1798d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:43.603601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06b1b917-e78a-4f5a-8361-dd1d55d1798d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:43.603601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06b1b917-e78a-4f5a-8361-dd1d55d1798d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:43.604735 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06b1b917-e78a-4f5a-8361-dd1d55d1798d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:43.793323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-06b1b917-e78a-4f5a-8361-dd1d55d1798d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:43.803840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-06b1b917-e78a-4f5a-8361-dd1d55d1798d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.216377 Sep 15 19:30:43.804695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 253/509] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:43 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:43.959847 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-258ccf4f-b16a-4e8c-848b-79a47e8a7b08 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:43.961859 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-258ccf4f-b16a-4e8c-848b-79a47e8a7b08 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:43.976172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bce62087-cb6e-4d60-851b-1c00a93368e0 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:43.977686 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bce62087-cb6e-4d60-851b-1c00a93368e0 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:43.980733 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-258ccf4f-b16a-4e8c-848b-79a47e8a7b08 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:43.987072 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-258ccf4f-b16a-4e8c-848b-79a47e8a7b08 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:43.987971 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-258ccf4f-b16a-4e8c-848b-79a47e8a7b08 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:43.989016 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-258ccf4f-b16a-4e8c-848b-79a47e8a7b08 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:43.989703 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-258ccf4f-b16a-4e8c-848b-79a47e8a7b08 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:43.990315 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-258ccf4f-b16a-4e8c-848b-79a47e8a7b08 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:43.996521 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bce62087-cb6e-4d60-851b-1c00a93368e0 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:43.997489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bce62087-cb6e-4d60-851b-1c00a93368e0 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:43.998426 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bce62087-cb6e-4d60-851b-1c00a93368e0 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:43.999617 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bce62087-cb6e-4d60-851b-1c00a93368e0 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:44.000399 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bce62087-cb6e-4d60-851b-1c00a93368e0 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:44.000982 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bce62087-cb6e-4d60-851b-1c00a93368e0 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:44.226862 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-258ccf4f-b16a-4e8c-848b-79a47e8a7b08 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:44.237788 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-258ccf4f-b16a-4e8c-848b-79a47e8a7b08 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1681 microversion: 2.1 time: 0.291104 Sep 15 19:30:44.238744 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 257/510] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:43 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1681 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:44.249504 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bce62087-cb6e-4d60-851b-1c00a93368e0 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:44.263736 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bce62087-cb6e-4d60-851b-1c00a93368e0 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1752 microversion: 2.1 time: 0.291570 Sep 15 19:30:44.264717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 254/511] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:43 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1752 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:44.831174 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52a89669-1873-4de2-b1be-d7d90bdf70c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:44.832096 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52a89669-1873-4de2-b1be-d7d90bdf70c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:44.842236 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52a89669-1873-4de2-b1be-d7d90bdf70c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:44.843286 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52a89669-1873-4de2-b1be-d7d90bdf70c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:44.843892 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52a89669-1873-4de2-b1be-d7d90bdf70c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:44.845815 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52a89669-1873-4de2-b1be-d7d90bdf70c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:44.847214 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52a89669-1873-4de2-b1be-d7d90bdf70c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:44.848737 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52a89669-1873-4de2-b1be-d7d90bdf70c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:45.017958 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-52a89669-1873-4de2-b1be-d7d90bdf70c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:45.028131 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52a89669-1873-4de2-b1be-d7d90bdf70c0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.201156 Sep 15 19:30:45.029311 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 258/512] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:44 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:45.272853 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7e1166c9-2e40-4d0c-a7b5-16d5fa140424 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:45.274933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7e1166c9-2e40-4d0c-a7b5-16d5fa140424 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:45.286517 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e1166c9-2e40-4d0c-a7b5-16d5fa140424 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:45.287427 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e1166c9-2e40-4d0c-a7b5-16d5fa140424 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:45.288214 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e1166c9-2e40-4d0c-a7b5-16d5fa140424 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:45.289113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e1166c9-2e40-4d0c-a7b5-16d5fa140424 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:45.289743 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e1166c9-2e40-4d0c-a7b5-16d5fa140424 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:45.290311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e1166c9-2e40-4d0c-a7b5-16d5fa140424 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:45.291987 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-67593ad8-4935-4a3e-aa4e-bc1675426fb3 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:45.292617 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-67593ad8-4935-4a3e-aa4e-bc1675426fb3 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:45.303245 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67593ad8-4935-4a3e-aa4e-bc1675426fb3 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:45.304001 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67593ad8-4935-4a3e-aa4e-bc1675426fb3 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:45.305209 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67593ad8-4935-4a3e-aa4e-bc1675426fb3 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:45.307203 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67593ad8-4935-4a3e-aa4e-bc1675426fb3 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:45.307984 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67593ad8-4935-4a3e-aa4e-bc1675426fb3 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:45.308611 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67593ad8-4935-4a3e-aa4e-bc1675426fb3 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:45.444509 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7e1166c9-2e40-4d0c-a7b5-16d5fa140424 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:45.455000 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7e1166c9-2e40-4d0c-a7b5-16d5fa140424 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1613 microversion: 2.1 time: 0.192011 Sep 15 19:30:45.471016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 255/513] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:45 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1613 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:45.514893 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-67593ad8-4935-4a3e-aa4e-bc1675426fb3 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:45.530629 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-67593ad8-4935-4a3e-aa4e-bc1675426fb3 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1752 microversion: 2.1 time: 0.242613 Sep 15 19:30:45.547531 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 259/514] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:45 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1752 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:45.650157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-7598e441-fa4a-4f34-a4b8-0c1b4bc29713 req-57628517-26a1-467e-9ff4-34bba8997ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3532b103-32ed-4f98-988c-acdaaca65fa8", "name": "network-vif-deleted", "tag": "b92511d9-07c9-4977-aff4-3a688548dc81"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:45.666396 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-7598e441-fa4a-4f34-a4b8-0c1b4bc29713 req-57628517-26a1-467e-9ff4-34bba8997ba7 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:45.666878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-7598e441-fa4a-4f34-a4b8-0c1b4bc29713 req-57628517-26a1-467e-9ff4-34bba8997ba7 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:45.667577 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-7598e441-fa4a-4f34-a4b8-0c1b4bc29713 req-57628517-26a1-467e-9ff4-34bba8997ba7 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:45.691880 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-7598e441-fa4a-4f34-a4b8-0c1b4bc29713 req-57628517-26a1-467e-9ff4-34bba8997ba7 service nova] Creating event network-vif-deleted:b92511d9-07c9-4977-aff4-3a688548dc81 for instance 3532b103-32ed-4f98-988c-acdaaca65fa8 on hv-cinder-84984 Sep 15 19:30:45.717292 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-7598e441-fa4a-4f34-a4b8-0c1b4bc29713 req-57628517-26a1-467e-9ff4-34bba8997ba7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070091 Sep 15 19:30:45.717861 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 256/515] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:30:46.065360 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9da6b73-3abc-47b8-997a-ef2db4ce6ff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:46.066066 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a9da6b73-3abc-47b8-997a-ef2db4ce6ff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:46.079351 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9da6b73-3abc-47b8-997a-ef2db4ce6ff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:46.087348 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9da6b73-3abc-47b8-997a-ef2db4ce6ff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:46.087348 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9da6b73-3abc-47b8-997a-ef2db4ce6ff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:46.087348 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9da6b73-3abc-47b8-997a-ef2db4ce6ff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:46.087348 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9da6b73-3abc-47b8-997a-ef2db4ce6ff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:46.087915 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9da6b73-3abc-47b8-997a-ef2db4ce6ff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:46.281467 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a9da6b73-3abc-47b8-997a-ef2db4ce6ff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:46.294160 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a9da6b73-3abc-47b8-997a-ef2db4ce6ff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.238997 Sep 15 19:30:46.295507 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 260/516] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:46 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:46.479450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:46.480836 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:46.489294 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:46.489784 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:46.490225 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:46.491143 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:46.491819 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:46.492278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:46.536009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:46.536539 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:46.537070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:46.537534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lazy-loading 'fault' on Instance uuid 3532b103-32ed-4f98-988c-acdaaca65fa8 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:30:46.540780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:30:46.554538 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-49df8b2f-77f7-461d-8e08-d3fb1c314d33 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:46.555914 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-49df8b2f-77f7-461d-8e08-d3fb1c314d33 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:46.565960 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49df8b2f-77f7-461d-8e08-d3fb1c314d33 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:46.566746 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49df8b2f-77f7-461d-8e08-d3fb1c314d33 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:46.572330 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49df8b2f-77f7-461d-8e08-d3fb1c314d33 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:46.573098 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49df8b2f-77f7-461d-8e08-d3fb1c314d33 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:46.573564 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49df8b2f-77f7-461d-8e08-d3fb1c314d33 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:46.574194 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49df8b2f-77f7-461d-8e08-d3fb1c314d33 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:46.602080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:46.612075 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ec119739-e6d7-487c-ac71-587059a77f2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1331 microversion: 2.1 time: 0.136672 Sep 15 19:30:46.627679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 257/517] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:46 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1331 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:46.768948 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-49df8b2f-77f7-461d-8e08-d3fb1c314d33 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:46.781077 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-49df8b2f-77f7-461d-8e08-d3fb1c314d33 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1752 microversion: 2.1 time: 0.228086 Sep 15 19:30:46.781077 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 261/518] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:46 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1752 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:47.326495 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4bbade2d-d6d1-4cb8-9f08-da58ad4d7143 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:47.327868 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4bbade2d-d6d1-4cb8-9f08-da58ad4d7143 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:47.342674 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4bbade2d-d6d1-4cb8-9f08-da58ad4d7143 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:47.343681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4bbade2d-d6d1-4cb8-9f08-da58ad4d7143 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:47.344734 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4bbade2d-d6d1-4cb8-9f08-da58ad4d7143 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:47.346673 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4bbade2d-d6d1-4cb8-9f08-da58ad4d7143 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:47.347855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4bbade2d-d6d1-4cb8-9f08-da58ad4d7143 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:47.350133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4bbade2d-d6d1-4cb8-9f08-da58ad4d7143 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:47.635489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4bbade2d-d6d1-4cb8-9f08-da58ad4d7143 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:47.642921 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:47.646522 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:47.646831 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4bbade2d-d6d1-4cb8-9f08-da58ad4d7143 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.327563 Sep 15 19:30:47.647416 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 258/519] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:47 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:47.656892 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:47.663541 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:47.664723 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:47.665672 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:47.666260 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:47.666903 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:47.718049 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:47.719506 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:47.719976 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:47.720427 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lazy-loading 'fault' on Instance uuid 3532b103-32ed-4f98-988c-acdaaca65fa8 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:30:47.765573 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:47.779138 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ecc3c0f1-94bd-4b49-af7b-a56b4a1baf92 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 200 len: 1331 microversion: 2.1 time: 0.141038 Sep 15 19:30:47.793702 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 262/520] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:47 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 1331 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:47.803668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e8c4f981-dd33-474b-a515-983f52ddc284 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:47.804426 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e8c4f981-dd33-474b-a515-983f52ddc284 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:47.811189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8c4f981-dd33-474b-a515-983f52ddc284 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:47.811707 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8c4f981-dd33-474b-a515-983f52ddc284 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:47.812153 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8c4f981-dd33-474b-a515-983f52ddc284 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:47.812898 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8c4f981-dd33-474b-a515-983f52ddc284 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:47.813357 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8c4f981-dd33-474b-a515-983f52ddc284 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:47.813784 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8c4f981-dd33-474b-a515-983f52ddc284 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:47.996214 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e8c4f981-dd33-474b-a515-983f52ddc284 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:48.010149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e8c4f981-dd33-474b-a515-983f52ddc284 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1755 microversion: 2.1 time: 0.210196 Sep 15 19:30:48.010737 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 259/521] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:47 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:48.671275 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e7b1134-a7bb-430c-bb65-5ea5a6b95c11 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:48.671955 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e7b1134-a7bb-430c-bb65-5ea5a6b95c11 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:48.678713 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e7b1134-a7bb-430c-bb65-5ea5a6b95c11 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:48.679197 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e7b1134-a7bb-430c-bb65-5ea5a6b95c11 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:48.679633 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e7b1134-a7bb-430c-bb65-5ea5a6b95c11 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:48.680999 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e7b1134-a7bb-430c-bb65-5ea5a6b95c11 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:48.681456 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e7b1134-a7bb-430c-bb65-5ea5a6b95c11 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:48.682139 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e7b1134-a7bb-430c-bb65-5ea5a6b95c11 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:48.802423 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-496c76f8-99bf-431e-99fa-000058a36d8e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:48.803775 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-496c76f8-99bf-431e-99fa-000058a36d8e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:48.811772 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-496c76f8-99bf-431e-99fa-000058a36d8e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:48.812643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-496c76f8-99bf-431e-99fa-000058a36d8e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:48.813309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-496c76f8-99bf-431e-99fa-000058a36d8e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:48.814282 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-496c76f8-99bf-431e-99fa-000058a36d8e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:48.815011 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-496c76f8-99bf-431e-99fa-000058a36d8e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:48.815692 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-496c76f8-99bf-431e-99fa-000058a36d8e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:48.832786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-496c76f8-99bf-431e-99fa-000058a36d8e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-496c76f8-99bf-431e-99fa-000058a36d8e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 HTTP/1.1 Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:30:48.834560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:30:48.836514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:30:48.836514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:30:48.836514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:30:48.836514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:30:48.836514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:30:48.836514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:30:48.836514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:30:48.836514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:30:48.836514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:30:48.836514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:30:48.836514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:30:48.836514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '3532b103-32ed-4f98-988c-acdaaca65fa8'} Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:30:48.837276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:30:48.839755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:30:48.841920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-496c76f8-99bf-431e-99fa-000058a36d8e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 404 to user: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:30:48.841920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-496c76f8-99bf-431e-99fa-000058a36d8e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 404 len: 111 microversion: 2.1 time: 0.037507 Sep 15 19:30:48.841920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 260/522] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:48 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:30:48.846365 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-47c5e540-53d8-4353-9437-5dcf6a878637 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '.version_select at 0x7f551eaad8b0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:48.847875 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e7b1134-a7bb-430c-bb65-5ea5a6b95c11 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:48.859440 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e7b1134-a7bb-430c-bb65-5ea5a6b95c11 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.192062 Sep 15 19:30:48.860619 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 263/523] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:48 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:48.958060 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-47c5e540-53d8-4353-9437-5dcf6a878637 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-453785919" status: 202 len: 0 microversion: 2.1 time: 0.115548 Sep 15 19:30:48.963143 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 261/524] 10.222.0.18 () {58 vars in 1218 bytes} [Thu Sep 15 19:30:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-453785919 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:30:49.885177 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33c0b389-702e-438e-9751-6800bf877660 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:49.885778 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-33c0b389-702e-438e-9751-6800bf877660 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:49.896513 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33c0b389-702e-438e-9751-6800bf877660 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:49.897017 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33c0b389-702e-438e-9751-6800bf877660 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:49.897484 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33c0b389-702e-438e-9751-6800bf877660 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:49.898200 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33c0b389-702e-438e-9751-6800bf877660 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:49.899212 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33c0b389-702e-438e-9751-6800bf877660 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:49.899639 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33c0b389-702e-438e-9751-6800bf877660 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:50.063458 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ec0dd67e-b788-4f62-a2e0-e9d9198357cf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Action: 'create', calling method: .version_select at 0x7f551ead8ca0>, body: {"keypair": {"name": "tempest-keypair-1919551565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtOaf2Npa6q8EEDHRan/mb967yiqnRb54rXhXcm19CRgr+dkzJGMut2qavoVGHtvbNYGU+WePLUrZC1FdjFveu08JW/vAV9XiThkT90Egju69mHtwtivksxA06nOSxiVA=="}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:50.084045 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-33c0b389-702e-438e-9751-6800bf877660 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:50.100998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-ec0dd67e-b788-4f62-a2e0-e9d9198357cf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:30:50.101119 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33c0b389-702e-438e-9751-6800bf877660 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.214068 Sep 15 19:30:50.101119 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 264/525] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:49 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:50.101318 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-ec0dd67e-b788-4f62-a2e0-e9d9198357cf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for user 0e37c8ca70ad4b6e8430a71d0f5e564f and project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:30:50.263323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ec0dd67e-b788-4f62-a2e0-e9d9198357cf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.204437 Sep 15 19:30:50.264071 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 262/526] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 15 19:30:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:30:51.121929 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b0ad9f4a-613e-4774-aa50-3aa0daa96d35 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:51.121929 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b0ad9f4a-613e-4774-aa50-3aa0daa96d35 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:51.129086 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0ad9f4a-613e-4774-aa50-3aa0daa96d35 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:51.129954 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0ad9f4a-613e-4774-aa50-3aa0daa96d35 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:51.130726 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0ad9f4a-613e-4774-aa50-3aa0daa96d35 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:51.132039 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0ad9f4a-613e-4774-aa50-3aa0daa96d35 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:51.132922 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0ad9f4a-613e-4774-aa50-3aa0daa96d35 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:51.134402 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0ad9f4a-613e-4774-aa50-3aa0daa96d35 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:51.319517 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b0ad9f4a-613e-4774-aa50-3aa0daa96d35 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:51.328002 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b0ad9f4a-613e-4774-aa50-3aa0daa96d35 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.211476 Sep 15 19:30:51.328603 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 265/527] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:51 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:52.353547 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e1387292-9c79-4568-8ec2-70e7581eefad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:52.354192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e1387292-9c79-4568-8ec2-70e7581eefad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:52.361170 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1387292-9c79-4568-8ec2-70e7581eefad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:52.361663 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1387292-9c79-4568-8ec2-70e7581eefad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:52.362101 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1387292-9c79-4568-8ec2-70e7581eefad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:52.362821 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1387292-9c79-4568-8ec2-70e7581eefad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:52.363276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1387292-9c79-4568-8ec2-70e7581eefad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:52.363728 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1387292-9c79-4568-8ec2-70e7581eefad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:52.867147 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e1387292-9c79-4568-8ec2-70e7581eefad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:52.878692 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e1387292-9c79-4568-8ec2-70e7581eefad tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.529510 Sep 15 19:30:52.888370 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 263/528] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:52 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:53.667493 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1381715895", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f608162d-6498-4eba-ac51-7e7b4de51e0d"}], "security_groups": [{"name": "tempest-securitygroup--1677731293"}], "key_name": "tempest-keypair-1919551565", "user_data": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:53.780150 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] validate_networks() for [('f608162d-6498-4eba-ac51-7e7b4de51e0d', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:30:53.902248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fea0abaf-f9a3-41b7-866f-5e9c8a4a8187 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:53.903038 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fea0abaf-f9a3-41b7-866f-5e9c8a4a8187 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:53.915277 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fea0abaf-f9a3-41b7-866f-5e9c8a4a8187 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:53.915819 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fea0abaf-f9a3-41b7-866f-5e9c8a4a8187 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:53.916293 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fea0abaf-f9a3-41b7-866f-5e9c8a4a8187 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:53.917004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fea0abaf-f9a3-41b7-866f-5e9c8a4a8187 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:53.917457 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fea0abaf-f9a3-41b7-866f-5e9c8a4a8187 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:53.917882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fea0abaf-f9a3-41b7-866f-5e9c8a4a8187 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:54.059020 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fea0abaf-f9a3-41b7-866f-5e9c8a4a8187 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:54.068408 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fea0abaf-f9a3-41b7-866f-5e9c8a4a8187 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.170569 Sep 15 19:30:54.069002 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 264/529] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:53 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:30:54.164416 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:30:54.164844 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:30:54.165353 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:30:54.165813 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:30:54.166228 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:30:54.175054 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:54.175535 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:54.176007 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:54.176736 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:54.177187 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:54.177614 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:54.196343 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:30:54.200591 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for user 0e37c8ca70ad4b6e8430a71d0f5e564f and project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'instances', 'ram', 'cores'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:30:54.211889 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:30:54.214221 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:30:54.352753 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-666e48cb-d966-43b0-a8fb-06104dc52caf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.689954 Sep 15 19:30:54.353375 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 266/530] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:30:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 19:30:54.368575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b0054c46-9687-40ad-bc75-4d3810aafc56 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:54.369847 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b0054c46-9687-40ad-bc75-4d3810aafc56 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:54.433325 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b0054c46-9687-40ad-bc75-4d3810aafc56 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:54.440336 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b0054c46-9687-40ad-bc75-4d3810aafc56 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1242 microversion: 2.1 time: 0.079228 Sep 15 19:30:54.441606 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 265/531] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:54 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:55.093390 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e5c4d263-66ad-4053-b743-4844d6d56c3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:55.094004 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e5c4d263-66ad-4053-b743-4844d6d56c3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:55.100319 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5c4d263-66ad-4053-b743-4844d6d56c3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:55.100806 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5c4d263-66ad-4053-b743-4844d6d56c3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:55.101249 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5c4d263-66ad-4053-b743-4844d6d56c3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:55.102633 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5c4d263-66ad-4053-b743-4844d6d56c3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:55.103084 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5c4d263-66ad-4053-b743-4844d6d56c3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:55.103513 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5c4d263-66ad-4053-b743-4844d6d56c3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:55.242997 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e5c4d263-66ad-4053-b743-4844d6d56c3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:55.252109 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e5c4d263-66ad-4053-b743-4844d6d56c3d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.163099 Sep 15 19:30:55.253079 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 267/532] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:55 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:30:55.464501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5cdd6a3f-3b82-4fa0-b44f-6c4b949c08c0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:55.465077 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5cdd6a3f-3b82-4fa0-b44f-6c4b949c08c0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:55.471839 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5cdd6a3f-3b82-4fa0-b44f-6c4b949c08c0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:55.472331 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5cdd6a3f-3b82-4fa0-b44f-6c4b949c08c0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:55.472893 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5cdd6a3f-3b82-4fa0-b44f-6c4b949c08c0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:55.473599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5cdd6a3f-3b82-4fa0-b44f-6c4b949c08c0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:55.474144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5cdd6a3f-3b82-4fa0-b44f-6c4b949c08c0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:55.474570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5cdd6a3f-3b82-4fa0-b44f-6c4b949c08c0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:55.540959 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5cdd6a3f-3b82-4fa0-b44f-6c4b949c08c0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:55.548679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5cdd6a3f-3b82-4fa0-b44f-6c4b949c08c0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1246 microversion: 2.1 time: 0.088959 Sep 15 19:30:55.549295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 266/533] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:55 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:56.279328 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f6bbfbf1-2910-4806-840b-b984fe0207be tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:56.280328 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f6bbfbf1-2910-4806-840b-b984fe0207be tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:56.287024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6bbfbf1-2910-4806-840b-b984fe0207be tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:56.291290 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6bbfbf1-2910-4806-840b-b984fe0207be tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:56.291290 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6bbfbf1-2910-4806-840b-b984fe0207be tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:56.291290 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6bbfbf1-2910-4806-840b-b984fe0207be tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:56.291290 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6bbfbf1-2910-4806-840b-b984fe0207be tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:56.291702 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6bbfbf1-2910-4806-840b-b984fe0207be tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:56.433981 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f6bbfbf1-2910-4806-840b-b984fe0207be tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:56.442730 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f6bbfbf1-2910-4806-840b-b984fe0207be tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.170845 Sep 15 19:30:56.443303 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 268/534] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:56 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:56.571711 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3e016e1e-cf52-4a35-8db3-19686c2c0fda tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:56.572374 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3e016e1e-cf52-4a35-8db3-19686c2c0fda tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:56.578953 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e016e1e-cf52-4a35-8db3-19686c2c0fda tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:56.579439 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e016e1e-cf52-4a35-8db3-19686c2c0fda tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:56.579969 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e016e1e-cf52-4a35-8db3-19686c2c0fda tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:56.580702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e016e1e-cf52-4a35-8db3-19686c2c0fda tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:56.581160 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e016e1e-cf52-4a35-8db3-19686c2c0fda tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:56.581590 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e016e1e-cf52-4a35-8db3-19686c2c0fda tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:56.650989 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3e016e1e-cf52-4a35-8db3-19686c2c0fda tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:56.659034 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3e016e1e-cf52-4a35-8db3-19686c2c0fda tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1294 microversion: 2.1 time: 0.091211 Sep 15 19:30:56.672045 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 267/535] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:56 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:57.466313 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02489ede-5cd6-41c4-ba18-520460e28d2c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:57.466860 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02489ede-5cd6-41c4-ba18-520460e28d2c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:57.473418 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02489ede-5cd6-41c4-ba18-520460e28d2c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:57.473923 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02489ede-5cd6-41c4-ba18-520460e28d2c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:57.474367 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02489ede-5cd6-41c4-ba18-520460e28d2c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:57.475074 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02489ede-5cd6-41c4-ba18-520460e28d2c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:57.475526 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02489ede-5cd6-41c4-ba18-520460e28d2c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:57.475975 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02489ede-5cd6-41c4-ba18-520460e28d2c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:57.612471 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-02489ede-5cd6-41c4-ba18-520460e28d2c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:57.619879 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02489ede-5cd6-41c4-ba18-520460e28d2c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.157911 Sep 15 19:30:57.620465 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 269/536] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:57 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:57.684873 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2eb5340c-0d86-49e6-8b32-303bc762903b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:57.685493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2eb5340c-0d86-49e6-8b32-303bc762903b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:57.691995 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2eb5340c-0d86-49e6-8b32-303bc762903b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:57.692483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2eb5340c-0d86-49e6-8b32-303bc762903b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:57.692920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2eb5340c-0d86-49e6-8b32-303bc762903b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:57.693617 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2eb5340c-0d86-49e6-8b32-303bc762903b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:57.694065 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2eb5340c-0d86-49e6-8b32-303bc762903b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:57.694487 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2eb5340c-0d86-49e6-8b32-303bc762903b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:57.775200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2eb5340c-0d86-49e6-8b32-303bc762903b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:57.782885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2eb5340c-0d86-49e6-8b32-303bc762903b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1312 microversion: 2.1 time: 0.102607 Sep 15 19:30:57.783462 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 268/537] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:57 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:30:58.139080 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84f33026-f807-4b02-9012-adb440ae2822 tempest-TestVolumeBootPattern-514337844 tempest-TestVolumeBootPattern-514337844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1218803205", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1611656672", "security_groups": [{"name": "tempest-secgroup-smoke-2013503314"}], "block_device_mapping_v2": [{"uuid": "d947502a-ac95-433d-b4a0-df0f5fe98d96", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a981a0db-9c1c-4f3a-9868-1f446f3a457d"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:30:58.259713 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-84f33026-f807-4b02-9012-adb440ae2822 tempest-TestVolumeBootPattern-514337844 tempest-TestVolumeBootPattern-514337844-project] validate_networks() for [('a981a0db-9c1c-4f3a-9868-1f446f3a457d', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:30:58.644156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e5c486f4-bfcd-49cc-87dd-10a6d11cbdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:58.644759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e5c486f4-bfcd-49cc-87dd-10a6d11cbdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:58.650897 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5c486f4-bfcd-49cc-87dd-10a6d11cbdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:58.651456 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5c486f4-bfcd-49cc-87dd-10a6d11cbdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:58.651921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5c486f4-bfcd-49cc-87dd-10a6d11cbdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:58.652945 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5c486f4-bfcd-49cc-87dd-10a6d11cbdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:58.653386 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5c486f4-bfcd-49cc-87dd-10a6d11cbdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:58.653813 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5c486f4-bfcd-49cc-87dd-10a6d11cbdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:58.891747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e5c486f4-bfcd-49cc-87dd-10a6d11cbdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:58.908718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e5c486f4-bfcd-49cc-87dd-10a6d11cbdbf tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.268418 Sep 15 19:30:58.909570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 269/538] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:58 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:30:58.921593 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-33d45e90-57e8-4e26-aa91-d68125bc3fbb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:58.923179 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-33d45e90-57e8-4e26-aa91-d68125bc3fbb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:58.933785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-33d45e90-57e8-4e26-aa91-d68125bc3fbb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:58.934445 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-33d45e90-57e8-4e26-aa91-d68125bc3fbb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:58.935035 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-33d45e90-57e8-4e26-aa91-d68125bc3fbb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:58.935785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-33d45e90-57e8-4e26-aa91-d68125bc3fbb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:58.936446 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-33d45e90-57e8-4e26-aa91-d68125bc3fbb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:58.937178 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-33d45e90-57e8-4e26-aa91-d68125bc3fbb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:59.136313 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-33d45e90-57e8-4e26-aa91-d68125bc3fbb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:30:59.144906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-33d45e90-57e8-4e26-aa91-d68125bc3fbb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1368 microversion: 2.1 time: 0.233758 Sep 15 19:30:59.145483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 270/539] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:30:58 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:30:59.593148 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3e2b3511-25d3-46e5-bbd2-6598c790cf75 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:30:59.593844 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3e2b3511-25d3-46e5-bbd2-6598c790cf75 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:30:59.601472 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e2b3511-25d3-46e5-bbd2-6598c790cf75 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:59.603385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e2b3511-25d3-46e5-bbd2-6598c790cf75 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:59.603636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e2b3511-25d3-46e5-bbd2-6598c790cf75 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:59.606948 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e2b3511-25d3-46e5-bbd2-6598c790cf75 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:30:59.607395 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e2b3511-25d3-46e5-bbd2-6598c790cf75 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:30:59.608741 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e2b3511-25d3-46e5-bbd2-6598c790cf75 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:30:59.710059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-3e2b3511-25d3-46e5-bbd2-6598c790cf75 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lazy-loading 'services' on Instance uuid 8ddcd684-503e-4123-9078-c4821c63519f {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:31:00.018967 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3e2b3511-25d3-46e5-bbd2-6598c790cf75 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/os-volume_attachments/e64f525f-20ca-44ae-817c-bc94e954b245" status: 202 len: 0 microversion: 2.1 time: 0.429695 Sep 15 19:31:00.035022 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 271/540] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 15 19:30:59 2022] DELETE /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/os-volume_attachments/e64f525f-20ca-44ae-817c-bc94e954b245 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 19:31:00.050539 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9e7353b6-13cd-4166-8923-82f7b55b0422 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:00.051714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9e7353b6-13cd-4166-8923-82f7b55b0422 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:00.061115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e7353b6-13cd-4166-8923-82f7b55b0422 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:00.062285 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e7353b6-13cd-4166-8923-82f7b55b0422 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:00.063027 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e7353b6-13cd-4166-8923-82f7b55b0422 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:00.064143 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e7353b6-13cd-4166-8923-82f7b55b0422 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:00.064796 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e7353b6-13cd-4166-8923-82f7b55b0422 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:00.067974 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e7353b6-13cd-4166-8923-82f7b55b0422 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:00.266565 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9e7353b6-13cd-4166-8923-82f7b55b0422 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:00.277436 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9e7353b6-13cd-4166-8923-82f7b55b0422 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.238271 Sep 15 19:31:00.278394 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 272/541] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:00 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:00.284436 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-71a42ac7-4110-4879-9b18-68a7117f980b req-56196317-c94e-4bc1-a928-b2418f05cbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "958ffdf6-6239-4d43-a0ba-0769a4b3cfa4", "tag": "08bcba4d-cc67-49aa-a757-7898965bb03a"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:00.297089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-71a42ac7-4110-4879-9b18-68a7117f980b req-56196317-c94e-4bc1-a928-b2418f05cbb8 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:00.297525 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-71a42ac7-4110-4879-9b18-68a7117f980b req-56196317-c94e-4bc1-a928-b2418f05cbb8 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:00.301642 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-71a42ac7-4110-4879-9b18-68a7117f980b req-56196317-c94e-4bc1-a928-b2418f05cbb8 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:00.309971 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-71a42ac7-4110-4879-9b18-68a7117f980b req-56196317-c94e-4bc1-a928-b2418f05cbb8 service nova] Creating event network-changed:08bcba4d-cc67-49aa-a757-7898965bb03a for instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 on hv-cinder-84984 Sep 15 19:31:00.315320 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-71a42ac7-4110-4879-9b18-68a7117f980b req-56196317-c94e-4bc1-a928-b2418f05cbb8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034933 Sep 15 19:31:00.315955 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 273/542] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:31:00.321133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-30ca9e1b-bfec-4943-a26a-057653c645b9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:00.321827 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-30ca9e1b-bfec-4943-a26a-057653c645b9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:00.328074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30ca9e1b-bfec-4943-a26a-057653c645b9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:00.328838 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30ca9e1b-bfec-4943-a26a-057653c645b9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:00.329176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30ca9e1b-bfec-4943-a26a-057653c645b9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:00.330038 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30ca9e1b-bfec-4943-a26a-057653c645b9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:00.330488 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30ca9e1b-bfec-4943-a26a-057653c645b9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:00.330911 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30ca9e1b-bfec-4943-a26a-057653c645b9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:00.467859 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-30ca9e1b-bfec-4943-a26a-057653c645b9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:00.476048 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-30ca9e1b-bfec-4943-a26a-057653c645b9 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1368 microversion: 2.1 time: 0.158835 Sep 15 19:31:00.476631 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 274/543] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:00 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:01.190240 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-27f25da6-4712-4dde-9d5f-7baaa4f30282 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:01.197702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-27f25da6-4712-4dde-9d5f-7baaa4f30282 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:01.198189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-27f25da6-4712-4dde-9d5f-7baaa4f30282 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:01.200862 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-27f25da6-4712-4dde-9d5f-7baaa4f30282 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:01.221901 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-27f25da6-4712-4dde-9d5f-7baaa4f30282 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Going to try to stop instance {{(pid=121041) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 15 19:31:01.525459 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-27f25da6-4712-4dde-9d5f-7baaa4f30282 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "POST /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/action" status: 202 len: 0 microversion: 2.1 time: 0.339176 Sep 15 19:31:01.526058 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 275/544] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:31:01 2022] POST /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 19:31:01.531192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9b073c44-43da-4aea-ba3d-fbaf3179a3f4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:01.531917 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9b073c44-43da-4aea-ba3d-fbaf3179a3f4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:01.538280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b073c44-43da-4aea-ba3d-fbaf3179a3f4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:01.538761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b073c44-43da-4aea-ba3d-fbaf3179a3f4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:01.539194 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b073c44-43da-4aea-ba3d-fbaf3179a3f4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:01.540417 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b073c44-43da-4aea-ba3d-fbaf3179a3f4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:01.540867 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b073c44-43da-4aea-ba3d-fbaf3179a3f4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:01.541284 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b073c44-43da-4aea-ba3d-fbaf3179a3f4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:01.675360 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9b073c44-43da-4aea-ba3d-fbaf3179a3f4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:01.678941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:01.684911 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9b073c44-43da-4aea-ba3d-fbaf3179a3f4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.157745 Sep 15 19:31:01.685528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 276/545] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:01 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:01.690065 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-66b7a3a0-d9ba-44a9-a713-01d330cd226c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:01.691127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-66b7a3a0-d9ba-44a9-a713-01d330cd226c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:01.696702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66b7a3a0-d9ba-44a9-a713-01d330cd226c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:01.697220 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66b7a3a0-d9ba-44a9-a713-01d330cd226c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:01.697661 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66b7a3a0-d9ba-44a9-a713-01d330cd226c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:01.698356 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66b7a3a0-d9ba-44a9-a713-01d330cd226c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:01.698810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66b7a3a0-d9ba-44a9-a713-01d330cd226c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:01.699233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66b7a3a0-d9ba-44a9-a713-01d330cd226c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:01.885903 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-66b7a3a0-d9ba-44a9-a713-01d330cd226c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:01.893891 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-66b7a3a0-d9ba-44a9-a713-01d330cd226c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1368 microversion: 2.1 time: 0.207359 Sep 15 19:31:01.894561 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 277/546] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:01 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:01.899099 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2e183bf0-29d9-4467-b052-4d73de978224 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:01.900300 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2e183bf0-29d9-4467-b052-4d73de978224 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:01.906249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2e183bf0-29d9-4467-b052-4d73de978224 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:01.906812 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2e183bf0-29d9-4467-b052-4d73de978224 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:01.907314 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2e183bf0-29d9-4467-b052-4d73de978224 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:01.908133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2e183bf0-29d9-4467-b052-4d73de978224 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:01.913873 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2e183bf0-29d9-4467-b052-4d73de978224 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:01.917584 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2e183bf0-29d9-4467-b052-4d73de978224 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:02.106909 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2e183bf0-29d9-4467-b052-4d73de978224 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:02.114859 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2e183bf0-29d9-4467-b052-4d73de978224 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1678 microversion: 2.1 time: 0.219282 Sep 15 19:31:02.115515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 278/547] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:01 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:02.120594 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1015587896", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "networks": [{"uuid": "b7b1b4db-7cb7-47a8-9ce9-f4ee2a46f058"}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:02.178532 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] validate_networks() for [('b7b1b4db-7cb7-47a8-9ce9-f4ee2a46f058', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:31:02.945636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:31:02.946837 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:31:02.947131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:31:02.947565 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:31:02.948265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:31:02.958631 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:02.959149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:02.959585 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:02.960350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:02.960807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:02.961230 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:02.978758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Getting quotas for project ee88123fe2e34b02a00baeb6f74869aa. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:31:02.982881 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Getting quotas for user 8c76463423664f649bd018d853010cad and project ee88123fe2e34b02a00baeb6f74869aa. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:31:02.995336 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:31:02.997720 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:31:03.182141 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cd86fe65-fab2-49c6-83cc-66855b8e675d tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.065027 Sep 15 19:31:03.189777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 279/548] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:31:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 19:31:03.193436 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7ae6d03d-883b-4711-a147-f3fa935e08c3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:03.194140 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7ae6d03d-883b-4711-a147-f3fa935e08c3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:03.200999 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ae6d03d-883b-4711-a147-f3fa935e08c3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:03.201478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ae6d03d-883b-4711-a147-f3fa935e08c3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:03.201908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ae6d03d-883b-4711-a147-f3fa935e08c3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:03.202607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ae6d03d-883b-4711-a147-f3fa935e08c3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:03.203051 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ae6d03d-883b-4711-a147-f3fa935e08c3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:03.203488 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ae6d03d-883b-4711-a147-f3fa935e08c3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:03.363775 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7ae6d03d-883b-4711-a147-f3fa935e08c3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:03.378291 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7ae6d03d-883b-4711-a147-f3fa935e08c3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.193682 Sep 15 19:31:03.379027 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 280/549] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:03 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:03.385461 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0f5461a1-f948-4bff-8621-081bde4acede tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:03.385461 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0f5461a1-f948-4bff-8621-081bde4acede tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:03.391477 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0f5461a1-f948-4bff-8621-081bde4acede tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:03.392147 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0f5461a1-f948-4bff-8621-081bde4acede tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:03.392585 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0f5461a1-f948-4bff-8621-081bde4acede tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:03.393317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0f5461a1-f948-4bff-8621-081bde4acede tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:03.393788 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0f5461a1-f948-4bff-8621-081bde4acede tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:03.394231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0f5461a1-f948-4bff-8621-081bde4acede tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:03.541784 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0f5461a1-f948-4bff-8621-081bde4acede tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:03.549596 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0f5461a1-f948-4bff-8621-081bde4acede tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1368 microversion: 2.1 time: 0.169508 Sep 15 19:31:03.550172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 281/550] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:03 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:03.561962 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9cdbe89e-4cea-4c93-8e36-537c3316f9a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:03.561962 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9cdbe89e-4cea-4c93-8e36-537c3316f9a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:03.562536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cdbe89e-4cea-4c93-8e36-537c3316f9a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:03.563005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cdbe89e-4cea-4c93-8e36-537c3316f9a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:03.563445 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cdbe89e-4cea-4c93-8e36-537c3316f9a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:03.564177 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cdbe89e-4cea-4c93-8e36-537c3316f9a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:03.564627 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cdbe89e-4cea-4c93-8e36-537c3316f9a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:03.565051 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cdbe89e-4cea-4c93-8e36-537c3316f9a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:03.710861 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9cdbe89e-4cea-4c93-8e36-537c3316f9a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:03.711343 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9cdbe89e-4cea-4c93-8e36-537c3316f9a9 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1678 microversion: 2.1 time: 0.160135 Sep 15 19:31:03.712455 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 282/551] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:03 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:03.716853 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5f5a1fdf-4c72-4b50-9f33-c7c5ceb5b473 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:03.717452 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5f5a1fdf-4c72-4b50-9f33-c7c5ceb5b473 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:03.719195 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:03.770263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5f5a1fdf-4c72-4b50-9f33-c7c5ceb5b473 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:03.777921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5f5a1fdf-4c72-4b50-9f33-c7c5ceb5b473 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1219 microversion: 2.1 time: 0.064448 Sep 15 19:31:03.778502 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 283/552] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:03 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:04.185774 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:04.207335 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:04.407004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8c8339d7-96aa-483e-a8ba-4bdd889ca873 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:04.407581 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8c8339d7-96aa-483e-a8ba-4bdd889ca873 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:04.414774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c8339d7-96aa-483e-a8ba-4bdd889ca873 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:04.415330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c8339d7-96aa-483e-a8ba-4bdd889ca873 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:04.415758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c8339d7-96aa-483e-a8ba-4bdd889ca873 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:04.416502 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c8339d7-96aa-483e-a8ba-4bdd889ca873 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:04.416952 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c8339d7-96aa-483e-a8ba-4bdd889ca873 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:04.417369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c8339d7-96aa-483e-a8ba-4bdd889ca873 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:04.553020 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8c8339d7-96aa-483e-a8ba-4bdd889ca873 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:04.562511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8c8339d7-96aa-483e-a8ba-4bdd889ca873 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.159888 Sep 15 19:31:04.563095 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 284/553] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:04 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:04.573744 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b0a7f73a-f7a2-45df-99f1-92afc94926a2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:04.574681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b0a7f73a-f7a2-45df-99f1-92afc94926a2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:04.581726 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0a7f73a-f7a2-45df-99f1-92afc94926a2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:04.585193 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0a7f73a-f7a2-45df-99f1-92afc94926a2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:04.585193 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0a7f73a-f7a2-45df-99f1-92afc94926a2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:04.585193 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0a7f73a-f7a2-45df-99f1-92afc94926a2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:04.585193 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0a7f73a-f7a2-45df-99f1-92afc94926a2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:04.585554 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0a7f73a-f7a2-45df-99f1-92afc94926a2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:04.715409 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b0a7f73a-f7a2-45df-99f1-92afc94926a2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:04.723266 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b0a7f73a-f7a2-45df-99f1-92afc94926a2 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1368 microversion: 2.1 time: 0.153343 Sep 15 19:31:04.723868 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 285/554] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:04 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:04.734067 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9fa5e809-c256-41aa-aa7d-4fb9552a962f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:04.734681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9fa5e809-c256-41aa-aa7d-4fb9552a962f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:04.740572 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9fa5e809-c256-41aa-aa7d-4fb9552a962f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:04.741057 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9fa5e809-c256-41aa-aa7d-4fb9552a962f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:04.741497 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9fa5e809-c256-41aa-aa7d-4fb9552a962f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:04.742196 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9fa5e809-c256-41aa-aa7d-4fb9552a962f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:04.742646 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9fa5e809-c256-41aa-aa7d-4fb9552a962f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:04.743635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9fa5e809-c256-41aa-aa7d-4fb9552a962f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:04.881057 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9fa5e809-c256-41aa-aa7d-4fb9552a962f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:04.888975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9fa5e809-c256-41aa-aa7d-4fb9552a962f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1678 microversion: 2.1 time: 0.158593 Sep 15 19:31:04.889543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 286/555] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:04 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:04.894138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9c0c7dd5-072e-4f62-8ae6-22699259d3b7 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:04.894740 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9c0c7dd5-072e-4f62-8ae6-22699259d3b7 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:04.900994 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c0c7dd5-072e-4f62-8ae6-22699259d3b7 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:04.901501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c0c7dd5-072e-4f62-8ae6-22699259d3b7 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:04.901948 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c0c7dd5-072e-4f62-8ae6-22699259d3b7 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:04.902790 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c0c7dd5-072e-4f62-8ae6-22699259d3b7 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:04.903143 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c0c7dd5-072e-4f62-8ae6-22699259d3b7 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:04.903603 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c0c7dd5-072e-4f62-8ae6-22699259d3b7 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:04.967625 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9c0c7dd5-072e-4f62-8ae6-22699259d3b7 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:04.975433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9c0c7dd5-072e-4f62-8ae6-22699259d3b7 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1215 microversion: 2.1 time: 0.084897 Sep 15 19:31:04.976036 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 287/556] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:04 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:05.366695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-61ca3b1c-8a22-40e2-98d4-c3ca17b2bf0d req-f0f1b98c-1780-492d-990c-938085f0a94d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958ffdf6-6239-4d43-a0ba-0769a4b3cfa4", "name": "network-vif-plugged", "status": "completed", "tag": "08bcba4d-cc67-49aa-a757-7898965bb03a"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:05.376977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-61ca3b1c-8a22-40e2-98d4-c3ca17b2bf0d req-f0f1b98c-1780-492d-990c-938085f0a94d service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:05.377172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-61ca3b1c-8a22-40e2-98d4-c3ca17b2bf0d req-f0f1b98c-1780-492d-990c-938085f0a94d service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:05.377520 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-61ca3b1c-8a22-40e2-98d4-c3ca17b2bf0d req-f0f1b98c-1780-492d-990c-938085f0a94d service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:05.389373 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-61ca3b1c-8a22-40e2-98d4-c3ca17b2bf0d req-f0f1b98c-1780-492d-990c-938085f0a94d service nova] Creating event network-vif-plugged:08bcba4d-cc67-49aa-a757-7898965bb03a for instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 on hv-cinder-84984 Sep 15 19:31:05.394358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-61ca3b1c-8a22-40e2-98d4-c3ca17b2bf0d req-f0f1b98c-1780-492d-990c-938085f0a94d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031578 Sep 15 19:31:05.394971 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 288/557] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:31:05.599784 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5853b77f-7c2a-4a38-8e16-073d8235852d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:05.600623 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5853b77f-7c2a-4a38-8e16-073d8235852d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:05.608932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5853b77f-7c2a-4a38-8e16-073d8235852d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:05.609420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5853b77f-7c2a-4a38-8e16-073d8235852d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:05.609852 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5853b77f-7c2a-4a38-8e16-073d8235852d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:05.610559 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5853b77f-7c2a-4a38-8e16-073d8235852d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:05.611006 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5853b77f-7c2a-4a38-8e16-073d8235852d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:05.611430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5853b77f-7c2a-4a38-8e16-073d8235852d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:05.752226 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5853b77f-7c2a-4a38-8e16-073d8235852d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:05.761119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5853b77f-7c2a-4a38-8e16-073d8235852d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.166361 Sep 15 19:31:05.761703 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 289/558] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:05 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:05.766317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0c9e7830-dc15-4566-b2c8-caa431af338a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:05.766924 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0c9e7830-dc15-4566-b2c8-caa431af338a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:05.772747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c9e7830-dc15-4566-b2c8-caa431af338a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:05.773415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c9e7830-dc15-4566-b2c8-caa431af338a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:05.773877 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c9e7830-dc15-4566-b2c8-caa431af338a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:05.774758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c9e7830-dc15-4566-b2c8-caa431af338a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:05.775206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c9e7830-dc15-4566-b2c8-caa431af338a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:05.775623 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c9e7830-dc15-4566-b2c8-caa431af338a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:06.063487 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0c9e7830-dc15-4566-b2c8-caa431af338a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:06.074688 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0c9e7830-dc15-4566-b2c8-caa431af338a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1368 microversion: 2.1 time: 0.311385 Sep 15 19:31:06.087885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 290/559] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:05 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1368 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:06.095934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7bc1092e-0f5e-4a07-b192-e3b1f3690062 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:06.097511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7bc1092e-0f5e-4a07-b192-e3b1f3690062 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:06.104122 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7bc1092e-0f5e-4a07-b192-e3b1f3690062 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:06.104620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7bc1092e-0f5e-4a07-b192-e3b1f3690062 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:06.105089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7bc1092e-0f5e-4a07-b192-e3b1f3690062 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:06.105800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7bc1092e-0f5e-4a07-b192-e3b1f3690062 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:06.106251 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7bc1092e-0f5e-4a07-b192-e3b1f3690062 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:06.106676 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7bc1092e-0f5e-4a07-b192-e3b1f3690062 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:06.291848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7bc1092e-0f5e-4a07-b192-e3b1f3690062 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:06.299512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7bc1092e-0f5e-4a07-b192-e3b1f3690062 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1678 microversion: 2.1 time: 0.210516 Sep 15 19:31:06.300108 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 291/560] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:06 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:06.304466 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b4e19800-f437-4d0e-839b-56730972ef39 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:06.305063 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b4e19800-f437-4d0e-839b-56730972ef39 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:06.311523 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4e19800-f437-4d0e-839b-56730972ef39 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:06.312031 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4e19800-f437-4d0e-839b-56730972ef39 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:06.312460 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4e19800-f437-4d0e-839b-56730972ef39 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:06.313136 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4e19800-f437-4d0e-839b-56730972ef39 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:06.313583 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4e19800-f437-4d0e-839b-56730972ef39 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:06.314002 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4e19800-f437-4d0e-839b-56730972ef39 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:06.376404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b4e19800-f437-4d0e-839b-56730972ef39 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:06.384000 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b4e19800-f437-4d0e-839b-56730972ef39 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1277 microversion: 2.1 time: 0.082880 Sep 15 19:31:06.384561 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 292/561] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:06 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:06.785632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8805741c-6a0a-49d7-b237-2f8aeb03d26f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:06.786324 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8805741c-6a0a-49d7-b237-2f8aeb03d26f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:06.793310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8805741c-6a0a-49d7-b237-2f8aeb03d26f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:06.793791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8805741c-6a0a-49d7-b237-2f8aeb03d26f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:06.794222 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8805741c-6a0a-49d7-b237-2f8aeb03d26f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:06.794910 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8805741c-6a0a-49d7-b237-2f8aeb03d26f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:06.795362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8805741c-6a0a-49d7-b237-2f8aeb03d26f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:06.795827 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8805741c-6a0a-49d7-b237-2f8aeb03d26f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:07.030969 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8805741c-6a0a-49d7-b237-2f8aeb03d26f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:07.040516 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8805741c-6a0a-49d7-b237-2f8aeb03d26f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.259021 Sep 15 19:31:07.041098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 293/562] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:06 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:07.101671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ac02918a-07c5-4491-a45e-ef72ec7d396c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:07.102458 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ac02918a-07c5-4491-a45e-ef72ec7d396c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:07.108551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac02918a-07c5-4491-a45e-ef72ec7d396c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:07.108959 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac02918a-07c5-4491-a45e-ef72ec7d396c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:07.109394 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac02918a-07c5-4491-a45e-ef72ec7d396c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:07.110163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac02918a-07c5-4491-a45e-ef72ec7d396c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:07.110608 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac02918a-07c5-4491-a45e-ef72ec7d396c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:07.111030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac02918a-07c5-4491-a45e-ef72ec7d396c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:07.273927 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ac02918a-07c5-4491-a45e-ef72ec7d396c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:07.282484 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ac02918a-07c5-4491-a45e-ef72ec7d396c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1368 microversion: 2.1 time: 0.184673 Sep 15 19:31:07.283272 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 294/563] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:07 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:07.324791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-faf1b930-a49e-4226-a8ef-e3a87dc7b59a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:07.325431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-faf1b930-a49e-4226-a8ef-e3a87dc7b59a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:07.331529 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-faf1b930-a49e-4226-a8ef-e3a87dc7b59a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:07.332059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-faf1b930-a49e-4226-a8ef-e3a87dc7b59a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:07.332528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-faf1b930-a49e-4226-a8ef-e3a87dc7b59a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:07.333233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-faf1b930-a49e-4226-a8ef-e3a87dc7b59a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:07.333693 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-faf1b930-a49e-4226-a8ef-e3a87dc7b59a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:07.334135 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-faf1b930-a49e-4226-a8ef-e3a87dc7b59a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:07.599106 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-faf1b930-a49e-4226-a8ef-e3a87dc7b59a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:07.603314 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:07.608237 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-faf1b930-a49e-4226-a8ef-e3a87dc7b59a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1678 microversion: 2.1 time: 0.288200 Sep 15 19:31:07.608815 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 295/564] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:07 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1678 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:07.613666 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-53934a06-fb6c-496d-81ff-a9481bceff54 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:07.614392 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-53934a06-fb6c-496d-81ff-a9481bceff54 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:07.615484 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=76 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:07.622537 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53934a06-fb6c-496d-81ff-a9481bceff54 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:07.623018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53934a06-fb6c-496d-81ff-a9481bceff54 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:07.623461 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53934a06-fb6c-496d-81ff-a9481bceff54 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:07.624190 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53934a06-fb6c-496d-81ff-a9481bceff54 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:07.624639 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53934a06-fb6c-496d-81ff-a9481bceff54 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:07.625067 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53934a06-fb6c-496d-81ff-a9481bceff54 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:07.799848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-53934a06-fb6c-496d-81ff-a9481bceff54 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:07.808986 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-53934a06-fb6c-496d-81ff-a9481bceff54 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1319 microversion: 2.1 time: 0.199147 Sep 15 19:31:07.812888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 296/565] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:07 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:08.066584 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-05b73a2c-9ba1-4311-bf1f-af7481babc94 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:08.069263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-05b73a2c-9ba1-4311-bf1f-af7481babc94 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:08.074819 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05b73a2c-9ba1-4311-bf1f-af7481babc94 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:08.075421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05b73a2c-9ba1-4311-bf1f-af7481babc94 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:08.075989 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05b73a2c-9ba1-4311-bf1f-af7481babc94 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:08.076754 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05b73a2c-9ba1-4311-bf1f-af7481babc94 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:08.077337 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05b73a2c-9ba1-4311-bf1f-af7481babc94 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:08.082964 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05b73a2c-9ba1-4311-bf1f-af7481babc94 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:08.152506 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:08.287823 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-05b73a2c-9ba1-4311-bf1f-af7481babc94 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:08.301842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-05b73a2c-9ba1-4311-bf1f-af7481babc94 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.240753 Sep 15 19:31:08.302727 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 297/566] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:08 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:08.309820 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-40dade82-a0a2-4c7d-bec8-b67c1ec78872 req-38f49e45-ea8e-46d6-942a-803c9bd06a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b678c560-1f6f-4615-9a4b-b700d59aed1a", "tag": "f243b1f2-796e-4006-82ce-c3b9f6bb805f"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:08.319750 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-40dade82-a0a2-4c7d-bec8-b67c1ec78872 req-38f49e45-ea8e-46d6-942a-803c9bd06a0e service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:08.320237 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-40dade82-a0a2-4c7d-bec8-b67c1ec78872 req-38f49e45-ea8e-46d6-942a-803c9bd06a0e service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:08.320669 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-40dade82-a0a2-4c7d-bec8-b67c1ec78872 req-38f49e45-ea8e-46d6-942a-803c9bd06a0e service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:08.337791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-40dade82-a0a2-4c7d-bec8-b67c1ec78872 req-38f49e45-ea8e-46d6-942a-803c9bd06a0e service nova] Creating event network-changed:f243b1f2-796e-4006-82ce-c3b9f6bb805f for instance b678c560-1f6f-4615-9a4b-b700d59aed1a on hv-cinder-84984 Sep 15 19:31:08.342743 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-40dade82-a0a2-4c7d-bec8-b67c1ec78872 req-38f49e45-ea8e-46d6-942a-803c9bd06a0e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038816 Sep 15 19:31:08.343351 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 298/567] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:31:08.348330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7dfb3cc1-24b0-4a44-ae04-c773905d8054 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:08.349028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7dfb3cc1-24b0-4a44-ae04-c773905d8054 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:08.355338 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7dfb3cc1-24b0-4a44-ae04-c773905d8054 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:08.355993 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7dfb3cc1-24b0-4a44-ae04-c773905d8054 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:08.356294 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7dfb3cc1-24b0-4a44-ae04-c773905d8054 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:08.356995 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7dfb3cc1-24b0-4a44-ae04-c773905d8054 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:08.357484 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7dfb3cc1-24b0-4a44-ae04-c773905d8054 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:08.357873 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7dfb3cc1-24b0-4a44-ae04-c773905d8054 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:08.569315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7dfb3cc1-24b0-4a44-ae04-c773905d8054 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:08.577878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7dfb3cc1-24b0-4a44-ae04-c773905d8054 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1557 microversion: 2.1 time: 0.233371 Sep 15 19:31:08.578497 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 299/568] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:08 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1557 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:08.600675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7680dbd6-44ef-4401-925f-7fcce99c5cfb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:08.601329 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7680dbd6-44ef-4401-925f-7fcce99c5cfb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:08.607331 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7680dbd6-44ef-4401-925f-7fcce99c5cfb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:08.607957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7680dbd6-44ef-4401-925f-7fcce99c5cfb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:08.608400 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7680dbd6-44ef-4401-925f-7fcce99c5cfb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:08.609094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7680dbd6-44ef-4401-925f-7fcce99c5cfb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:08.609545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7680dbd6-44ef-4401-925f-7fcce99c5cfb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:08.609965 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7680dbd6-44ef-4401-925f-7fcce99c5cfb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:08.733865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7680dbd6-44ef-4401-925f-7fcce99c5cfb tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136836 Sep 15 19:31:08.734492 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 300/569] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 15 19:31:08 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:31:08.739042 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6cb11955-dc1d-4f46-bb34-c9e1d8e344a2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:08.740606 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6cb11955-dc1d-4f46-bb34-c9e1d8e344a2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:08.749752 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cb11955-dc1d-4f46-bb34-c9e1d8e344a2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:08.750454 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cb11955-dc1d-4f46-bb34-c9e1d8e344a2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:08.751244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cb11955-dc1d-4f46-bb34-c9e1d8e344a2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:08.752539 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cb11955-dc1d-4f46-bb34-c9e1d8e344a2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:08.753366 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cb11955-dc1d-4f46-bb34-c9e1d8e344a2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:08.754558 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cb11955-dc1d-4f46-bb34-c9e1d8e344a2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:08.925516 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6cb11955-dc1d-4f46-bb34-c9e1d8e344a2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:08.934285 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6cb11955-dc1d-4f46-bb34-c9e1d8e344a2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1678 microversion: 2.1 time: 0.198762 Sep 15 19:31:08.934939 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 301/570] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:08 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:08.940489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4bb32839-9eb9-4976-bb6f-122b3d65cc0e tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:08.941173 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4bb32839-9eb9-4976-bb6f-122b3d65cc0e tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:08.948659 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4bb32839-9eb9-4976-bb6f-122b3d65cc0e tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:08.949224 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4bb32839-9eb9-4976-bb6f-122b3d65cc0e tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:08.949815 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4bb32839-9eb9-4976-bb6f-122b3d65cc0e tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:08.950711 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4bb32839-9eb9-4976-bb6f-122b3d65cc0e tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:08.951258 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4bb32839-9eb9-4976-bb6f-122b3d65cc0e tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:08.951732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4bb32839-9eb9-4976-bb6f-122b3d65cc0e tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:09.097902 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4bb32839-9eb9-4976-bb6f-122b3d65cc0e tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:09.107421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4bb32839-9eb9-4976-bb6f-122b3d65cc0e tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1319 microversion: 2.1 time: 0.171518 Sep 15 19:31:09.108113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 302/571] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:08 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:09.327897 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c7995c9c-9524-43ba-91a7-7c5d9c7ac990 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:09.328513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c7995c9c-9524-43ba-91a7-7c5d9c7ac990 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:09.335046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7995c9c-9524-43ba-91a7-7c5d9c7ac990 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:09.335529 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7995c9c-9524-43ba-91a7-7c5d9c7ac990 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:09.335994 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7995c9c-9524-43ba-91a7-7c5d9c7ac990 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:09.336723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7995c9c-9524-43ba-91a7-7c5d9c7ac990 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:09.342525 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7995c9c-9524-43ba-91a7-7c5d9c7ac990 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:09.342525 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7995c9c-9524-43ba-91a7-7c5d9c7ac990 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:09.490077 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c7995c9c-9524-43ba-91a7-7c5d9c7ac990 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:09.498918 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c7995c9c-9524-43ba-91a7-7c5d9c7ac990 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.174902 Sep 15 19:31:09.499513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 303/572] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:09 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:09.818803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-ebb26a78-d885-440d-bb7e-bfd694dbc72a req-029154b0-b028-4f74-892e-eec4fdddcd7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "958ffdf6-6239-4d43-a0ba-0769a4b3cfa4", "tag": "08bcba4d-cc67-49aa-a757-7898965bb03a"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:09.829165 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ebb26a78-d885-440d-bb7e-bfd694dbc72a req-029154b0-b028-4f74-892e-eec4fdddcd7b service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:09.829652 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ebb26a78-d885-440d-bb7e-bfd694dbc72a req-029154b0-b028-4f74-892e-eec4fdddcd7b service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:09.830078 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ebb26a78-d885-440d-bb7e-bfd694dbc72a req-029154b0-b028-4f74-892e-eec4fdddcd7b service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:09.843494 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-ebb26a78-d885-440d-bb7e-bfd694dbc72a req-029154b0-b028-4f74-892e-eec4fdddcd7b service nova] Creating event network-changed:08bcba4d-cc67-49aa-a757-7898965bb03a for instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 on hv-cinder-84984 Sep 15 19:31:09.849289 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-ebb26a78-d885-440d-bb7e-bfd694dbc72a req-029154b0-b028-4f74-892e-eec4fdddcd7b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033994 Sep 15 19:31:09.850082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 304/573] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:31:09.959599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ab34a498-7a27-4186-81b6-aad29cbb2f11 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:09.960256 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ab34a498-7a27-4186-81b6-aad29cbb2f11 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:09.967620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab34a498-7a27-4186-81b6-aad29cbb2f11 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:09.968135 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab34a498-7a27-4186-81b6-aad29cbb2f11 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:09.968581 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab34a498-7a27-4186-81b6-aad29cbb2f11 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:09.969441 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab34a498-7a27-4186-81b6-aad29cbb2f11 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:09.969912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab34a498-7a27-4186-81b6-aad29cbb2f11 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:09.970344 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab34a498-7a27-4186-81b6-aad29cbb2f11 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:10.228646 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ab34a498-7a27-4186-81b6-aad29cbb2f11 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:10.236412 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ab34a498-7a27-4186-81b6-aad29cbb2f11 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1678 microversion: 2.1 time: 0.281244 Sep 15 19:31:10.236995 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 305/574] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:09 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1678 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:10.241564 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-62ceeb6c-bc4b-4c49-9388-973052b8a4b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:10.242798 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-62ceeb6c-bc4b-4c49-9388-973052b8a4b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:10.249617 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62ceeb6c-bc4b-4c49-9388-973052b8a4b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:10.250145 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62ceeb6c-bc4b-4c49-9388-973052b8a4b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:10.250579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62ceeb6c-bc4b-4c49-9388-973052b8a4b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:10.251452 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62ceeb6c-bc4b-4c49-9388-973052b8a4b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:10.251925 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62ceeb6c-bc4b-4c49-9388-973052b8a4b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:10.252408 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62ceeb6c-bc4b-4c49-9388-973052b8a4b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:10.843379 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-62ceeb6c-bc4b-4c49-9388-973052b8a4b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:10.855972 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-62ceeb6c-bc4b-4c49-9388-973052b8a4b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1319 microversion: 2.1 time: 0.617853 Sep 15 19:31:10.856780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 306/575] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:10 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1319 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:10.865892 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ff409889-8501-4abf-b54c-7ed16e0a171e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:10.867320 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ff409889-8501-4abf-b54c-7ed16e0a171e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:10.879939 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff409889-8501-4abf-b54c-7ed16e0a171e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:10.881212 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff409889-8501-4abf-b54c-7ed16e0a171e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:10.882294 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff409889-8501-4abf-b54c-7ed16e0a171e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:10.883909 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff409889-8501-4abf-b54c-7ed16e0a171e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:10.885135 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff409889-8501-4abf-b54c-7ed16e0a171e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:10.886169 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff409889-8501-4abf-b54c-7ed16e0a171e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:11.173221 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ff409889-8501-4abf-b54c-7ed16e0a171e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:11.181866 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ff409889-8501-4abf-b54c-7ed16e0a171e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.323536 Sep 15 19:31:11.182483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 307/576] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:10 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:11.266620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d84dd0df-47d9-4bd6-aa5f-dfbc3e663749 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:11.267244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d84dd0df-47d9-4bd6-aa5f-dfbc3e663749 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:11.273810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d84dd0df-47d9-4bd6-aa5f-dfbc3e663749 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:11.275078 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d84dd0df-47d9-4bd6-aa5f-dfbc3e663749 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:11.275514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d84dd0df-47d9-4bd6-aa5f-dfbc3e663749 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:11.276245 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d84dd0df-47d9-4bd6-aa5f-dfbc3e663749 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:11.276696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d84dd0df-47d9-4bd6-aa5f-dfbc3e663749 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:11.277114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d84dd0df-47d9-4bd6-aa5f-dfbc3e663749 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:11.433333 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d84dd0df-47d9-4bd6-aa5f-dfbc3e663749 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:11.441528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d84dd0df-47d9-4bd6-aa5f-dfbc3e663749 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1678 microversion: 2.1 time: 0.178814 Sep 15 19:31:11.442213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 308/577] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:11 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:11.898331 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d88f5c2f-b448-4425-ba3f-50c62d3f37b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:11.898959 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d88f5c2f-b448-4425-ba3f-50c62d3f37b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:11.906671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d88f5c2f-b448-4425-ba3f-50c62d3f37b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:11.907157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d88f5c2f-b448-4425-ba3f-50c62d3f37b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:11.907860 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d88f5c2f-b448-4425-ba3f-50c62d3f37b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:11.908724 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d88f5c2f-b448-4425-ba3f-50c62d3f37b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:11.909318 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d88f5c2f-b448-4425-ba3f-50c62d3f37b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:11.909816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d88f5c2f-b448-4425-ba3f-50c62d3f37b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:12.066985 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d88f5c2f-b448-4425-ba3f-50c62d3f37b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:12.074682 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d88f5c2f-b448-4425-ba3f-50c62d3f37b3 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1319 microversion: 2.1 time: 0.180487 Sep 15 19:31:12.075265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 309/578] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:11 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:12.205150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a48aa722-79f9-4d75-be6b-849496d1bbeb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:12.205811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a48aa722-79f9-4d75-be6b-849496d1bbeb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:12.212135 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a48aa722-79f9-4d75-be6b-849496d1bbeb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:12.212675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a48aa722-79f9-4d75-be6b-849496d1bbeb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:12.213088 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a48aa722-79f9-4d75-be6b-849496d1bbeb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:12.213786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a48aa722-79f9-4d75-be6b-849496d1bbeb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:12.214245 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a48aa722-79f9-4d75-be6b-849496d1bbeb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:12.214725 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a48aa722-79f9-4d75-be6b-849496d1bbeb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:12.357014 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a48aa722-79f9-4d75-be6b-849496d1bbeb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:12.365763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a48aa722-79f9-4d75-be6b-849496d1bbeb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.164618 Sep 15 19:31:12.366354 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 310/579] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:12 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:12.467254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-66c6c8e5-2232-44c5-8ea6-28f37f22cead tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:12.467804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-66c6c8e5-2232-44c5-8ea6-28f37f22cead tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:12.473893 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66c6c8e5-2232-44c5-8ea6-28f37f22cead tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:12.474569 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66c6c8e5-2232-44c5-8ea6-28f37f22cead tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:12.474984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66c6c8e5-2232-44c5-8ea6-28f37f22cead tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:12.476248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66c6c8e5-2232-44c5-8ea6-28f37f22cead tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:12.476698 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66c6c8e5-2232-44c5-8ea6-28f37f22cead tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:12.477347 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66c6c8e5-2232-44c5-8ea6-28f37f22cead tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:12.614604 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-66c6c8e5-2232-44c5-8ea6-28f37f22cead tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:12.623570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-66c6c8e5-2232-44c5-8ea6-28f37f22cead tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1655 microversion: 2.1 time: 0.160419 Sep 15 19:31:12.624210 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 311/580] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:12 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1655 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:12.646236 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8a50e3f3-727e-4c41-9157-46269e97e4fd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:12.652677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a50e3f3-727e-4c41-9157-46269e97e4fd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:12.653159 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a50e3f3-727e-4c41-9157-46269e97e4fd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:12.653594 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a50e3f3-727e-4c41-9157-46269e97e4fd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:12.677265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8a50e3f3-727e-4c41-9157-46269e97e4fd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Going to try to start instance {{(pid=121041) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 15 19:31:12.879432 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8a50e3f3-727e-4c41-9157-46269e97e4fd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "POST /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/action" status: 202 len: 0 microversion: 2.1 time: 0.236932 Sep 15 19:31:12.880070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 312/581] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:31:12 2022] POST /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 19:31:12.889140 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-70f81138-60af-4101-a600-1a0489f80e06 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:12.894460 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-70f81138-60af-4101-a600-1a0489f80e06 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:12.895984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70f81138-60af-4101-a600-1a0489f80e06 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:12.896462 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70f81138-60af-4101-a600-1a0489f80e06 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:12.896882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70f81138-60af-4101-a600-1a0489f80e06 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:12.897572 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70f81138-60af-4101-a600-1a0489f80e06 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:12.898033 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70f81138-60af-4101-a600-1a0489f80e06 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:12.898470 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70f81138-60af-4101-a600-1a0489f80e06 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:12.903937 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:12.968379 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:13.048974 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-70f81138-60af-4101-a600-1a0489f80e06 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:13.057100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-70f81138-60af-4101-a600-1a0489f80e06 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1664 microversion: 2.1 time: 0.171884 Sep 15 19:31:13.057942 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 313/582] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:12 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1664 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:13.097537 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-95a9d1da-704c-4cd7-a5c8-68fcec8fd8d4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:13.098161 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-95a9d1da-704c-4cd7-a5c8-68fcec8fd8d4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:13.104259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-95a9d1da-704c-4cd7-a5c8-68fcec8fd8d4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:13.104749 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-95a9d1da-704c-4cd7-a5c8-68fcec8fd8d4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:13.105192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-95a9d1da-704c-4cd7-a5c8-68fcec8fd8d4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:13.105893 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-95a9d1da-704c-4cd7-a5c8-68fcec8fd8d4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:13.106351 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-95a9d1da-704c-4cd7-a5c8-68fcec8fd8d4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:13.106783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-95a9d1da-704c-4cd7-a5c8-68fcec8fd8d4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:13.385864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-95a9d1da-704c-4cd7-a5c8-68fcec8fd8d4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:13.385864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-95a9d1da-704c-4cd7-a5c8-68fcec8fd8d4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1319 microversion: 2.1 time: 0.240843 Sep 15 19:31:13.385864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 314/583] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:13 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:13.394633 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ec106eba-1d83-4ebb-a368-8caba3fdada8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:13.395272 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ec106eba-1d83-4ebb-a368-8caba3fdada8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:13.402199 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec106eba-1d83-4ebb-a368-8caba3fdada8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:13.402632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec106eba-1d83-4ebb-a368-8caba3fdada8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:13.403113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec106eba-1d83-4ebb-a368-8caba3fdada8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:13.403879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec106eba-1d83-4ebb-a368-8caba3fdada8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:13.404349 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec106eba-1d83-4ebb-a368-8caba3fdada8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:13.404861 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec106eba-1d83-4ebb-a368-8caba3fdada8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:13.622035 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ec106eba-1d83-4ebb-a368-8caba3fdada8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:13.630579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ec106eba-1d83-4ebb-a368-8caba3fdada8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.241271 Sep 15 19:31:13.631172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 315/584] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:13 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:13.836465 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-88fa4e28-0563-462b-8515-97eb00c1b42e req-eebe38bc-9aa6-449e-b11b-712adb2fa07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b678c560-1f6f-4615-9a4b-b700d59aed1a", "name": "network-vif-plugged", "status": "completed", "tag": "f243b1f2-796e-4006-82ce-c3b9f6bb805f"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:13.841552 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=14 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:13.847214 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-88fa4e28-0563-462b-8515-97eb00c1b42e req-eebe38bc-9aa6-449e-b11b-712adb2fa07d service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:13.854670 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-88fa4e28-0563-462b-8515-97eb00c1b42e req-eebe38bc-9aa6-449e-b11b-712adb2fa07d service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:13.854670 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-88fa4e28-0563-462b-8515-97eb00c1b42e req-eebe38bc-9aa6-449e-b11b-712adb2fa07d service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:13.860702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-88fa4e28-0563-462b-8515-97eb00c1b42e req-eebe38bc-9aa6-449e-b11b-712adb2fa07d service nova] Creating event network-vif-plugged:f243b1f2-796e-4006-82ce-c3b9f6bb805f for instance b678c560-1f6f-4615-9a4b-b700d59aed1a on hv-cinder-84984 Sep 15 19:31:13.865552 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-88fa4e28-0563-462b-8515-97eb00c1b42e req-eebe38bc-9aa6-449e-b11b-712adb2fa07d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032832 Sep 15 19:31:13.866375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 316/585] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:31:14.081668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bc17ddc5-86de-46e9-9d1d-c7f8edc0a78c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:14.082470 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bc17ddc5-86de-46e9-9d1d-c7f8edc0a78c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:14.090269 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc17ddc5-86de-46e9-9d1d-c7f8edc0a78c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:14.090754 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc17ddc5-86de-46e9-9d1d-c7f8edc0a78c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:14.092037 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc17ddc5-86de-46e9-9d1d-c7f8edc0a78c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:14.096167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc17ddc5-86de-46e9-9d1d-c7f8edc0a78c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:14.096167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc17ddc5-86de-46e9-9d1d-c7f8edc0a78c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:14.096167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc17ddc5-86de-46e9-9d1d-c7f8edc0a78c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:14.236591 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bc17ddc5-86de-46e9-9d1d-c7f8edc0a78c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:14.244921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bc17ddc5-86de-46e9-9d1d-c7f8edc0a78c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1664 microversion: 2.1 time: 0.167561 Sep 15 19:31:14.245534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 317/586] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:14 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:14.401543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-676b31e6-d9df-4443-98d7-6910e26697ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:14.402259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-676b31e6-d9df-4443-98d7-6910e26697ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:14.408262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-676b31e6-d9df-4443-98d7-6910e26697ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:14.410431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-676b31e6-d9df-4443-98d7-6910e26697ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:14.410431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-676b31e6-d9df-4443-98d7-6910e26697ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:14.410431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-676b31e6-d9df-4443-98d7-6910e26697ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:14.410431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-676b31e6-d9df-4443-98d7-6910e26697ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:14.410865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-676b31e6-d9df-4443-98d7-6910e26697ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:14.548840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-676b31e6-d9df-4443-98d7-6910e26697ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:14.562133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-676b31e6-d9df-4443-98d7-6910e26697ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1319 microversion: 2.1 time: 0.164807 Sep 15 19:31:14.563124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 318/587] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:14 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:14.659369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-91c38877-0ad8-49b6-a84e-6ec5c777cce2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:14.660506 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-91c38877-0ad8-49b6-a84e-6ec5c777cce2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:14.670656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91c38877-0ad8-49b6-a84e-6ec5c777cce2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:14.670988 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91c38877-0ad8-49b6-a84e-6ec5c777cce2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:14.671473 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91c38877-0ad8-49b6-a84e-6ec5c777cce2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:14.672282 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91c38877-0ad8-49b6-a84e-6ec5c777cce2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:14.672773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91c38877-0ad8-49b6-a84e-6ec5c777cce2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:14.673235 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91c38877-0ad8-49b6-a84e-6ec5c777cce2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:14.869334 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-91c38877-0ad8-49b6-a84e-6ec5c777cce2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:14.877627 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-91c38877-0ad8-49b6-a84e-6ec5c777cce2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.225941 Sep 15 19:31:14.878199 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 319/588] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:14 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:15.269483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a82657b4-7ed5-420b-9065-da090680d46e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:15.270088 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a82657b4-7ed5-420b-9065-da090680d46e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:15.276807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a82657b4-7ed5-420b-9065-da090680d46e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:15.277295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a82657b4-7ed5-420b-9065-da090680d46e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:15.277727 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a82657b4-7ed5-420b-9065-da090680d46e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:15.278500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a82657b4-7ed5-420b-9065-da090680d46e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:15.278950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a82657b4-7ed5-420b-9065-da090680d46e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:15.279365 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a82657b4-7ed5-420b-9065-da090680d46e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:15.423505 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a82657b4-7ed5-420b-9065-da090680d46e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:15.431402 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a82657b4-7ed5-420b-9065-da090680d46e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1668 microversion: 2.1 time: 0.165810 Sep 15 19:31:15.432007 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 320/589] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:15 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:15.591740 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a6e7d42c-41b9-4445-b616-ee59a620d742 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:15.592741 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a6e7d42c-41b9-4445-b616-ee59a620d742 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:15.603722 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6e7d42c-41b9-4445-b616-ee59a620d742 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:15.604590 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6e7d42c-41b9-4445-b616-ee59a620d742 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:15.605373 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6e7d42c-41b9-4445-b616-ee59a620d742 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:15.606612 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6e7d42c-41b9-4445-b616-ee59a620d742 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:15.607211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6e7d42c-41b9-4445-b616-ee59a620d742 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:15.608015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6e7d42c-41b9-4445-b616-ee59a620d742 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:15.750675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a6e7d42c-41b9-4445-b616-ee59a620d742 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:15.759229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a6e7d42c-41b9-4445-b616-ee59a620d742 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1319 microversion: 2.1 time: 0.175599 Sep 15 19:31:15.759846 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 321/590] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:15 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:15.902370 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0791bd0c-9602-4850-aa24-2c1542ae491c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:15.906226 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0791bd0c-9602-4850-aa24-2c1542ae491c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:15.909795 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0791bd0c-9602-4850-aa24-2c1542ae491c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:15.910289 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0791bd0c-9602-4850-aa24-2c1542ae491c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:15.910890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0791bd0c-9602-4850-aa24-2c1542ae491c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:15.911642 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0791bd0c-9602-4850-aa24-2c1542ae491c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:15.912143 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0791bd0c-9602-4850-aa24-2c1542ae491c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:15.912565 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0791bd0c-9602-4850-aa24-2c1542ae491c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:16.063024 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0791bd0c-9602-4850-aa24-2c1542ae491c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:16.072293 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0791bd0c-9602-4850-aa24-2c1542ae491c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.174537 Sep 15 19:31:16.073030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 322/591] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:15 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:16.782674 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d3ad2ed7-d0c7-43b4-ab45-0719529ee6bf tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:16.783382 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d3ad2ed7-d0c7-43b4-ab45-0719529ee6bf tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:16.790279 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3ad2ed7-d0c7-43b4-ab45-0719529ee6bf tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:16.791908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3ad2ed7-d0c7-43b4-ab45-0719529ee6bf tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:16.791908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3ad2ed7-d0c7-43b4-ab45-0719529ee6bf tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:16.791908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3ad2ed7-d0c7-43b4-ab45-0719529ee6bf tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:16.792494 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3ad2ed7-d0c7-43b4-ab45-0719529ee6bf tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:16.792918 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3ad2ed7-d0c7-43b4-ab45-0719529ee6bf tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:16.942588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d3ad2ed7-d0c7-43b4-ab45-0719529ee6bf tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:16.951704 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d3ad2ed7-d0c7-43b4-ab45-0719529ee6bf tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1508 microversion: 2.1 time: 0.172955 Sep 15 19:31:16.952284 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 323/592] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:16 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:17.096800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a62c480c-abb8-40e3-8437-92b9a0e7484f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:17.097504 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a62c480c-abb8-40e3-8437-92b9a0e7484f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:17.103582 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a62c480c-abb8-40e3-8437-92b9a0e7484f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:17.104106 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a62c480c-abb8-40e3-8437-92b9a0e7484f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:17.104541 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a62c480c-abb8-40e3-8437-92b9a0e7484f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:17.105239 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a62c480c-abb8-40e3-8437-92b9a0e7484f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:17.105695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a62c480c-abb8-40e3-8437-92b9a0e7484f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:17.106117 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a62c480c-abb8-40e3-8437-92b9a0e7484f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:17.247375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a62c480c-abb8-40e3-8437-92b9a0e7484f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:17.258363 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a62c480c-abb8-40e3-8437-92b9a0e7484f tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.165454 Sep 15 19:31:17.259573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 324/593] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:17 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:18.282684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c69754b2-2a42-47a8-9160-27e619a49459 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:18.283326 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c69754b2-2a42-47a8-9160-27e619a49459 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:18.291262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c69754b2-2a42-47a8-9160-27e619a49459 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:18.291893 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c69754b2-2a42-47a8-9160-27e619a49459 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:18.292372 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c69754b2-2a42-47a8-9160-27e619a49459 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:18.293407 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c69754b2-2a42-47a8-9160-27e619a49459 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:18.293813 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c69754b2-2a42-47a8-9160-27e619a49459 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:18.294375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c69754b2-2a42-47a8-9160-27e619a49459 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:18.438094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c69754b2-2a42-47a8-9160-27e619a49459 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:18.447881 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c69754b2-2a42-47a8-9160-27e619a49459 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.168594 Sep 15 19:31:18.448928 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 325/594] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:18 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:19.472292 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-18821d7b-a591-4cae-b17c-7652db634e37 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:19.472968 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-18821d7b-a591-4cae-b17c-7652db634e37 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:19.480213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18821d7b-a591-4cae-b17c-7652db634e37 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:19.480694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18821d7b-a591-4cae-b17c-7652db634e37 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:19.481125 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18821d7b-a591-4cae-b17c-7652db634e37 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:19.481813 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18821d7b-a591-4cae-b17c-7652db634e37 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:19.482259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18821d7b-a591-4cae-b17c-7652db634e37 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:19.482678 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18821d7b-a591-4cae-b17c-7652db634e37 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:19.632432 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-18821d7b-a591-4cae-b17c-7652db634e37 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:19.641162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-18821d7b-a591-4cae-b17c-7652db634e37 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.172754 Sep 15 19:31:19.641732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 326/595] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:19 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:20.665686 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b5bf4bad-690a-4012-8231-0e2eac3d729e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:20.666355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b5bf4bad-690a-4012-8231-0e2eac3d729e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:20.673557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5bf4bad-690a-4012-8231-0e2eac3d729e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:20.674039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5bf4bad-690a-4012-8231-0e2eac3d729e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:20.674475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5bf4bad-690a-4012-8231-0e2eac3d729e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:20.675247 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5bf4bad-690a-4012-8231-0e2eac3d729e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:20.675635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5bf4bad-690a-4012-8231-0e2eac3d729e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:20.676088 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5bf4bad-690a-4012-8231-0e2eac3d729e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:20.808322 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b5bf4bad-690a-4012-8231-0e2eac3d729e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:20.816723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b5bf4bad-690a-4012-8231-0e2eac3d729e tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.155772 Sep 15 19:31:20.817312 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 327/596] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:20 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:21.840232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2f76ad1c-cb1b-4f28-a2ab-be4066ac7ee6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:21.840895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2f76ad1c-cb1b-4f28-a2ab-be4066ac7ee6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:21.847573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f76ad1c-cb1b-4f28-a2ab-be4066ac7ee6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:21.848295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f76ad1c-cb1b-4f28-a2ab-be4066ac7ee6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:21.848732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f76ad1c-cb1b-4f28-a2ab-be4066ac7ee6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:21.849441 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f76ad1c-cb1b-4f28-a2ab-be4066ac7ee6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:21.849923 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f76ad1c-cb1b-4f28-a2ab-be4066ac7ee6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:21.850366 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f76ad1c-cb1b-4f28-a2ab-be4066ac7ee6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:22.025498 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2f76ad1c-cb1b-4f28-a2ab-be4066ac7ee6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:22.033969 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2f76ad1c-cb1b-4f28-a2ab-be4066ac7ee6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.197831 Sep 15 19:31:22.049013 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 328/597] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:21 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:23.059141 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a837b4cf-b3c6-485b-ac2b-72aa8a50c480 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:23.059787 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a837b4cf-b3c6-485b-ac2b-72aa8a50c480 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:23.066486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a837b4cf-b3c6-485b-ac2b-72aa8a50c480 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:23.066976 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a837b4cf-b3c6-485b-ac2b-72aa8a50c480 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:23.067417 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a837b4cf-b3c6-485b-ac2b-72aa8a50c480 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:23.068166 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a837b4cf-b3c6-485b-ac2b-72aa8a50c480 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:23.068618 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a837b4cf-b3c6-485b-ac2b-72aa8a50c480 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:23.069046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a837b4cf-b3c6-485b-ac2b-72aa8a50c480 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:23.209170 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a837b4cf-b3c6-485b-ac2b-72aa8a50c480 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:23.217865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a837b4cf-b3c6-485b-ac2b-72aa8a50c480 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1734 microversion: 2.1 time: 0.163223 Sep 15 19:31:23.218444 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 329/598] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:23 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:24.242014 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-52b39f71-769c-4b24-90c6-2b1e3b0a4e6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:24.242716 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-52b39f71-769c-4b24-90c6-2b1e3b0a4e6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:24.250017 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52b39f71-769c-4b24-90c6-2b1e3b0a4e6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:24.250594 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52b39f71-769c-4b24-90c6-2b1e3b0a4e6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:24.251033 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52b39f71-769c-4b24-90c6-2b1e3b0a4e6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:24.251758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52b39f71-769c-4b24-90c6-2b1e3b0a4e6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:24.252843 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52b39f71-769c-4b24-90c6-2b1e3b0a4e6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:24.253278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52b39f71-769c-4b24-90c6-2b1e3b0a4e6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:24.271717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:24.391961 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-52b39f71-769c-4b24-90c6-2b1e3b0a4e6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:24.400341 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-52b39f71-769c-4b24-90c6-2b1e3b0a4e6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1714 microversion: 2.1 time: 0.162559 Sep 15 19:31:24.401468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 330/599] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:24 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:24.511366 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-12d8f94a-1f2c-478f-92ae-242f5ac52203 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:24.511937 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-12d8f94a-1f2c-478f-92ae-242f5ac52203 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:24.518365 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12d8f94a-1f2c-478f-92ae-242f5ac52203 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:24.518849 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12d8f94a-1f2c-478f-92ae-242f5ac52203 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:24.519290 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12d8f94a-1f2c-478f-92ae-242f5ac52203 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:24.520015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12d8f94a-1f2c-478f-92ae-242f5ac52203 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:24.520471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12d8f94a-1f2c-478f-92ae-242f5ac52203 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:24.520981 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12d8f94a-1f2c-478f-92ae-242f5ac52203 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:24.608302 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-12d8f94a-1f2c-478f-92ae-242f5ac52203 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] HTTP exception thrown: Cannot 'detach_volume' instance 212105c1-8435-430c-9ffa-72e8a6bd2426 while it is in vm_state rescued Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-12d8f94a-1f2c-478f-92ae-242f5ac52203 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Request method failure captured: Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-volume_attachments/d52f6d82-8f48-4628-9d06-87743c7c0912 HTTP/1.1 Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2gP0Gamuz7MW6kt5fLWKd3NLL-PP3YSW0U9aHiJ2uXiR5ltQi77FsMQyXTqL_ThLEIKacMbb8OOMEUFv5IMw0TOPVnWuEE3VOpC98z4LA6wvz2NMPIxQroKGaTQtiVlHx-Xt0EbiHTVWLkl0p0ZJGv_y0Kwm5RmsVyVsM-g7xfCk Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 016f968319fd49d98506030c0bee6021 Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:31:24.609932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:31:24.611540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_016f968319fd49d98506030c0bee6021", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/016f968319fd49d98506030c0bee6021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/016f968319fd49d98506030c0bee6021"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/016f968319fd49d98506030c0bee6021"}]}] Sep 15 19:31:24.611540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:31:24.611540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 016f968319fd49d98506030c0bee6021 Sep 15 19:31:24.611540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:31:24.611540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-ServerRescueNegativeTestJSON-1036181242-project Sep 15 19:31:24.611540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:31:24.611540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:31:24.611540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 1d7c40b5232e46119434aeeb8a6ad4d0 Sep 15 19:31:24.611540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1036181242-project Sep 15 19:31:24.611540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:31:24.611540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Cannot 'detach_volume' instance 212105c1-8435-430c-9ffa-72e8a6bd2426 while it is in vm_state rescued Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'server_id': '212105c1-8435-430c-9ffa-72e8a6bd2426', 'id': 'd52f6d82-8f48-4628-9d06-87743c7c0912'} Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 212105c1-8435-430c-9ffa-72e8a6bd2426 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:31:24.612415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 212105c1-8435-430c-9ffa-72e8a6bd2426 while it is in vm_state rescued Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 212105c1-8435-430c-9ffa-72e8a6bd2426 while it is in vm_state rescued Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:24.613975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-12d8f94a-1f2c-478f-92ae-242f5ac52203 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Returning 409 to user: Cannot 'detach_volume' instance 212105c1-8435-430c-9ffa-72e8a6bd2426 while it is in vm_state rescued {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:31:24.615263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-12d8f94a-1f2c-478f-92ae-242f5ac52203 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "DELETE /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-volume_attachments/d52f6d82-8f48-4628-9d06-87743c7c0912" status: 409 len: 152 microversion: 2.1 time: 0.104342 Sep 15 19:31:24.615263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 331/600] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 15 19:31:24 2022] DELETE /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-volume_attachments/d52f6d82-8f48-4628-9d06-87743c7c0912 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 15 19:31:24.619999 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-13f72f5c-d173-4808-9083-8ededfd521fb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:24.620527 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-13f72f5c-d173-4808-9083-8ededfd521fb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:24.622305 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:24.627745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13f72f5c-d173-4808-9083-8ededfd521fb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:24.628230 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13f72f5c-d173-4808-9083-8ededfd521fb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:24.628666 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13f72f5c-d173-4808-9083-8ededfd521fb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:24.629358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13f72f5c-d173-4808-9083-8ededfd521fb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:24.629818 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13f72f5c-d173-4808-9083-8ededfd521fb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:24.630234 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13f72f5c-d173-4808-9083-8ededfd521fb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:24.886163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-13f72f5c-d173-4808-9083-8ededfd521fb tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "POST /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/action" status: 202 len: 0 microversion: 2.1 time: 0.269069 Sep 15 19:31:24.886791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 332/601] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:31:24 2022] POST /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:31:24.895705 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6640e0d0-6a32-4dac-b535-eedafff6c6d3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:24.896457 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6640e0d0-6a32-4dac-b535-eedafff6c6d3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:24.903242 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6640e0d0-6a32-4dac-b535-eedafff6c6d3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:24.903758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6640e0d0-6a32-4dac-b535-eedafff6c6d3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:24.904197 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6640e0d0-6a32-4dac-b535-eedafff6c6d3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:24.904899 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6640e0d0-6a32-4dac-b535-eedafff6c6d3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:24.905374 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6640e0d0-6a32-4dac-b535-eedafff6c6d3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:24.905799 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6640e0d0-6a32-4dac-b535-eedafff6c6d3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:25.042774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6640e0d0-6a32-4dac-b535-eedafff6c6d3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:25.051102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6640e0d0-6a32-4dac-b535-eedafff6c6d3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1722 microversion: 2.1 time: 0.159683 Sep 15 19:31:25.051688 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 333/602] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:24 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:26.074570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-789f9016-731e-4b6d-ac15-528c3c3f95d0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:26.075233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-789f9016-731e-4b6d-ac15-528c3c3f95d0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:26.081717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-789f9016-731e-4b6d-ac15-528c3c3f95d0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:26.082196 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-789f9016-731e-4b6d-ac15-528c3c3f95d0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:26.082634 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-789f9016-731e-4b6d-ac15-528c3c3f95d0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:26.083328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-789f9016-731e-4b6d-ac15-528c3c3f95d0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:26.083809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-789f9016-731e-4b6d-ac15-528c3c3f95d0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:26.084233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-789f9016-731e-4b6d-ac15-528c3c3f95d0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:26.212540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-789f9016-731e-4b6d-ac15-528c3c3f95d0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:26.221521 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-789f9016-731e-4b6d-ac15-528c3c3f95d0 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1722 microversion: 2.1 time: 0.150934 Sep 15 19:31:26.222519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 334/603] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:26 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:27.246055 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ff0618bf-06bc-497c-be18-eece00900602 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:27.246699 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ff0618bf-06bc-497c-be18-eece00900602 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:27.253413 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff0618bf-06bc-497c-be18-eece00900602 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:27.253925 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff0618bf-06bc-497c-be18-eece00900602 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:27.254393 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff0618bf-06bc-497c-be18-eece00900602 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:27.255101 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff0618bf-06bc-497c-be18-eece00900602 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:27.255553 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff0618bf-06bc-497c-be18-eece00900602 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:27.256019 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff0618bf-06bc-497c-be18-eece00900602 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:27.396112 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ff0618bf-06bc-497c-be18-eece00900602 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:27.405131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ff0618bf-06bc-497c-be18-eece00900602 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1722 microversion: 2.1 time: 0.163512 Sep 15 19:31:27.405821 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 335/604] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:27 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:28.292402 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ec94af24-c587-4556-a174-6f0f3fe98476 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-5768309"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:28.298189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ec94af24-c587-4556-a174-6f0f3fe98476 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:28.299587 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec94af24-c587-4556-a174-6f0f3fe98476 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:28.300099 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec94af24-c587-4556-a174-6f0f3fe98476 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:28.300532 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec94af24-c587-4556-a174-6f0f3fe98476 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:28.301225 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec94af24-c587-4556-a174-6f0f3fe98476 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:28.301674 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec94af24-c587-4556-a174-6f0f3fe98476 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:28.302157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec94af24-c587-4556-a174-6f0f3fe98476 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:28.441900 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.network.security_group_api [None req-ec94af24-c587-4556-a174-6f0f3fe98476 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Removing security group 685f99b2-457d-475d-b5ae-8621eaa6e266 from port 1d0a2bca-ad01-4592-b8f5-ddac6af30dc4 Sep 15 19:31:28.833016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ec94af24-c587-4556-a174-6f0f3fe98476 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "POST /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/action" status: 202 len: 0 microversion: 2.1 time: 0.544511 Sep 15 19:31:28.833716 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 336/605] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:31:28 2022] POST /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 19:31:28.840003 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6190cea3-49cc-4006-886f-74810479cff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:28.841230 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6190cea3-49cc-4006-886f-74810479cff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:28.847719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6190cea3-49cc-4006-886f-74810479cff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:28.849411 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6190cea3-49cc-4006-886f-74810479cff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:28.850090 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6190cea3-49cc-4006-886f-74810479cff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:28.851037 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6190cea3-49cc-4006-886f-74810479cff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:28.851821 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6190cea3-49cc-4006-886f-74810479cff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:28.852501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6190cea3-49cc-4006-886f-74810479cff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:29.019586 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6190cea3-49cc-4006-886f-74810479cff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:29.028530 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6190cea3-49cc-4006-886f-74810479cff8 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1728 microversion: 2.1 time: 0.193784 Sep 15 19:31:29.029320 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 337/606] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:28 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:29.033460 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-8380d805-a96a-4956-8245-fc108b0bf1a5 req-51aac5f8-a061-42c6-8702-bc83ed3f31e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdce58c-be13-4f4a-8a24-b3f3f002d77d", "tag": "1d0a2bca-ad01-4592-b8f5-ddac6af30dc4"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:29.043297 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-8380d805-a96a-4956-8245-fc108b0bf1a5 req-51aac5f8-a061-42c6-8702-bc83ed3f31e2 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:29.043879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-8380d805-a96a-4956-8245-fc108b0bf1a5 req-51aac5f8-a061-42c6-8702-bc83ed3f31e2 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:29.044313 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-8380d805-a96a-4956-8245-fc108b0bf1a5 req-51aac5f8-a061-42c6-8702-bc83ed3f31e2 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:29.057989 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-8380d805-a96a-4956-8245-fc108b0bf1a5 req-51aac5f8-a061-42c6-8702-bc83ed3f31e2 service nova] Creating event network-changed:1d0a2bca-ad01-4592-b8f5-ddac6af30dc4 for instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d on hv-cinder-84984 Sep 15 19:31:29.063329 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-8380d805-a96a-4956-8245-fc108b0bf1a5 req-51aac5f8-a061-42c6-8702-bc83ed3f31e2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032869 Sep 15 19:31:29.063717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 338/607] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:31:29.068933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2e224c8c-de79-4c07-83df-1d8c0617f14b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:29.070976 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2e224c8c-de79-4c07-83df-1d8c0617f14b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:29.075853 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2e224c8c-de79-4c07-83df-1d8c0617f14b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:29.076486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2e224c8c-de79-4c07-83df-1d8c0617f14b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:29.077151 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2e224c8c-de79-4c07-83df-1d8c0617f14b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:29.077855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2e224c8c-de79-4c07-83df-1d8c0617f14b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:29.078305 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2e224c8c-de79-4c07-83df-1d8c0617f14b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:29.078725 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2e224c8c-de79-4c07-83df-1d8c0617f14b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:29.272709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2e224c8c-de79-4c07-83df-1d8c0617f14b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.205688 Sep 15 19:31:29.272709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 339/608] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 15 19:31:29 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-interface => generated 284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:31:30.578942 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-145724da-0dff-4088-9fcf-9faeebb21ca2 req-2816900d-3205-4557-91cb-02b4b335d8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "212105c1-8435-430c-9ffa-72e8a6bd2426", "tag": "e07717f9-44fe-4be0-919e-d14afd6d6dcf"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:30.596303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-145724da-0dff-4088-9fcf-9faeebb21ca2 req-2816900d-3205-4557-91cb-02b4b335d8b2 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:30.598293 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-145724da-0dff-4088-9fcf-9faeebb21ca2 req-2816900d-3205-4557-91cb-02b4b335d8b2 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:30.599045 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-145724da-0dff-4088-9fcf-9faeebb21ca2 req-2816900d-3205-4557-91cb-02b4b335d8b2 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:30.617545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-145724da-0dff-4088-9fcf-9faeebb21ca2 req-2816900d-3205-4557-91cb-02b4b335d8b2 service nova] Creating event network-changed:e07717f9-44fe-4be0-919e-d14afd6d6dcf for instance 212105c1-8435-430c-9ffa-72e8a6bd2426 on hv-cinder-84984 Sep 15 19:31:30.623092 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-145724da-0dff-4088-9fcf-9faeebb21ca2 req-2816900d-3205-4557-91cb-02b4b335d8b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048657 Sep 15 19:31:30.624287 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 340/609] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:31:30.938912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ba8cf52f-fcbc-4d2c-a676-e649fe9a698b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:30.940334 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ba8cf52f-fcbc-4d2c-a676-e649fe9a698b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:30.946410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba8cf52f-fcbc-4d2c-a676-e649fe9a698b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:30.947205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba8cf52f-fcbc-4d2c-a676-e649fe9a698b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:30.951465 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba8cf52f-fcbc-4d2c-a676-e649fe9a698b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:30.951465 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba8cf52f-fcbc-4d2c-a676-e649fe9a698b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:30.951465 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba8cf52f-fcbc-4d2c-a676-e649fe9a698b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:30.951465 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba8cf52f-fcbc-4d2c-a676-e649fe9a698b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:31.038961 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-ba8cf52f-fcbc-4d2c-a676-e649fe9a698b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lazy-loading 'services' on Instance uuid dfdce58c-be13-4f4a-8a24-b3f3f002d77d {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:31:31.329171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ba8cf52f-fcbc-4d2c-a676-e649fe9a698b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/os-volume_attachments/5ef7fded-bad3-4c9a-b933-94a88fdca896" status: 202 len: 0 microversion: 2.1 time: 0.391227 Sep 15 19:31:31.329781 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 341/610] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 15 19:31:30 2022] DELETE /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/os-volume_attachments/5ef7fded-bad3-4c9a-b933-94a88fdca896 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:31:31.336246 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-744af5e5-1f9a-4ce0-bb30-be6c4a9120a1 req-556e54a9-31aa-4051-9854-9d8200eeaf4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdce58c-be13-4f4a-8a24-b3f3f002d77d", "tag": "1d0a2bca-ad01-4592-b8f5-ddac6af30dc4"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:31.348005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-744af5e5-1f9a-4ce0-bb30-be6c4a9120a1 req-556e54a9-31aa-4051-9854-9d8200eeaf4b service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:31.348841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-744af5e5-1f9a-4ce0-bb30-be6c4a9120a1 req-556e54a9-31aa-4051-9854-9d8200eeaf4b service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:31.349498 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-744af5e5-1f9a-4ce0-bb30-be6c4a9120a1 req-556e54a9-31aa-4051-9854-9d8200eeaf4b service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:31.362146 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-744af5e5-1f9a-4ce0-bb30-be6c4a9120a1 req-556e54a9-31aa-4051-9854-9d8200eeaf4b service nova] Creating event network-changed:1d0a2bca-ad01-4592-b8f5-ddac6af30dc4 for instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d on hv-cinder-84984 Sep 15 19:31:31.368542 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-744af5e5-1f9a-4ce0-bb30-be6c4a9120a1 req-556e54a9-31aa-4051-9854-9d8200eeaf4b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036586 Sep 15 19:31:31.370800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 342/611] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:31:31.376980 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5602c5b0-dd9e-4e9a-b10c-13738621a7e6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:31.379257 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5602c5b0-dd9e-4e9a-b10c-13738621a7e6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:31.387047 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5602c5b0-dd9e-4e9a-b10c-13738621a7e6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:31.387691 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5602c5b0-dd9e-4e9a-b10c-13738621a7e6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:31.388163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5602c5b0-dd9e-4e9a-b10c-13738621a7e6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:31.388890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5602c5b0-dd9e-4e9a-b10c-13738621a7e6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:31.389350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5602c5b0-dd9e-4e9a-b10c-13738621a7e6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:31.389779 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5602c5b0-dd9e-4e9a-b10c-13738621a7e6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:31.437142 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5602c5b0-dd9e-4e9a-b10c-13738621a7e6 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064847 Sep 15 19:31:31.438519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 343/612] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:31:31 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:31:32.450776 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1fa6c7f2-147a-4706-b40c-86b0078e8ea5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:32.452990 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1fa6c7f2-147a-4706-b40c-86b0078e8ea5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:32.459417 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fa6c7f2-147a-4706-b40c-86b0078e8ea5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:32.459938 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fa6c7f2-147a-4706-b40c-86b0078e8ea5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:32.460385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fa6c7f2-147a-4706-b40c-86b0078e8ea5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:32.461074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fa6c7f2-147a-4706-b40c-86b0078e8ea5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:32.461526 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fa6c7f2-147a-4706-b40c-86b0078e8ea5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:32.461957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fa6c7f2-147a-4706-b40c-86b0078e8ea5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:32.491264 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1fa6c7f2-147a-4706-b40c-86b0078e8ea5 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044964 Sep 15 19:31:32.492423 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 344/613] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:31:32 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:31:32.640145 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-94763d70-6f89-4f01-859a-1a2a8c9a2906 req-7a976404-a42d-4904-bab8-0f5a6977e11c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "212105c1-8435-430c-9ffa-72e8a6bd2426", "tag": "e07717f9-44fe-4be0-919e-d14afd6d6dcf"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:32.649998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-94763d70-6f89-4f01-859a-1a2a8c9a2906 req-7a976404-a42d-4904-bab8-0f5a6977e11c service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:32.650468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-94763d70-6f89-4f01-859a-1a2a8c9a2906 req-7a976404-a42d-4904-bab8-0f5a6977e11c service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:32.650917 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-94763d70-6f89-4f01-859a-1a2a8c9a2906 req-7a976404-a42d-4904-bab8-0f5a6977e11c service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:32.662014 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-94763d70-6f89-4f01-859a-1a2a8c9a2906 req-7a976404-a42d-4904-bab8-0f5a6977e11c service nova] Creating event network-changed:e07717f9-44fe-4be0-919e-d14afd6d6dcf for instance 212105c1-8435-430c-9ffa-72e8a6bd2426 on hv-cinder-84984 Sep 15 19:31:32.666893 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-94763d70-6f89-4f01-859a-1a2a8c9a2906 req-7a976404-a42d-4904-bab8-0f5a6977e11c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030445 Sep 15 19:31:32.667554 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 345/614] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:31:33.504644 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a6510411-f082-4a9d-8814-551f85767a2c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:33.506920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a6510411-f082-4a9d-8814-551f85767a2c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:33.513176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6510411-f082-4a9d-8814-551f85767a2c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:33.513650 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6510411-f082-4a9d-8814-551f85767a2c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:33.514071 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6510411-f082-4a9d-8814-551f85767a2c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:33.514760 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6510411-f082-4a9d-8814-551f85767a2c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:33.515205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6510411-f082-4a9d-8814-551f85767a2c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:33.515752 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6510411-f082-4a9d-8814-551f85767a2c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:33.545179 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a6510411-f082-4a9d-8814-551f85767a2c tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045467 Sep 15 19:31:33.545735 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 346/615] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:31:33 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 19:31:33.556039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0fe651fa-1426-43d1-b3a6-66e7439f2962 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:33.556521 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0fe651fa-1426-43d1-b3a6-66e7439f2962 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:33.562657 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fe651fa-1426-43d1-b3a6-66e7439f2962 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:33.566860 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fe651fa-1426-43d1-b3a6-66e7439f2962 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:33.566860 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fe651fa-1426-43d1-b3a6-66e7439f2962 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:33.566860 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fe651fa-1426-43d1-b3a6-66e7439f2962 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:33.566860 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fe651fa-1426-43d1-b3a6-66e7439f2962 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:33.567227 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fe651fa-1426-43d1-b3a6-66e7439f2962 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:33.757612 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-0fe651fa-1426-43d1-b3a6-66e7439f2962 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] HTTP exception thrown: Instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d is not attached to volume 5ef7fded-bad3-4c9a-b933-94a88fdca896 Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0fe651fa-1426-43d1-b3a6-66e7439f2962 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Request method failure captured: Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/os-volume_attachments/5ef7fded-bad3-4c9a-b933-94a88fdca896 HTTP/1.1 Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3ztPsXtBUQbHZRpfguPDEveaGKsNv7AbmKy_wON75MqfDpmwkGEJkvQlBQqi_Fe8mUJah7sQ6LMX8TMGoV2s_n20Lha31iaNZloplCaJ0U6nJHLD_xAl82H_uSgBdDYQMtZumCdzc8nbM-cnn6v7LIKuzBA7-XMaMtMTKLWFUZEVek Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 4fd3f2da26af4d3db4c6db4ceb851558 Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-TestMinimumBasicScenario-875696926 Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:31:33.760548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:31:33.762016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4fd3f2da26af4d3db4c6db4ceb851558", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4fd3f2da26af4d3db4c6db4ceb851558"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4fd3f2da26af4d3db4c6db4ceb851558"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4fd3f2da26af4d3db4c6db4ceb851558"}]}] Sep 15 19:31:33.762016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-TestMinimumBasicScenario-875696926 Sep 15 19:31:33.762016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 4fd3f2da26af4d3db4c6db4ceb851558 Sep 15 19:31:33.762016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-TestMinimumBasicScenario-875696926 Sep 15 19:31:33.762016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-TestMinimumBasicScenario-875696926-project Sep 15 19:31:33.762016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:31:33.762016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:31:33.762016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: fd8d3fe4be354995b1698b9783ce6c65 Sep 15 19:31:33.762016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-TestMinimumBasicScenario-875696926-project Sep 15 19:31:33.762016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:31:33.762016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d is not attached to volume 5ef7fded-bad3-4c9a-b933-94a88fdca896 Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'server_id': 'dfdce58c-be13-4f4a-8a24-b3f3f002d77d', 'id': '5ef7fded-bad3-4c9a-b933-94a88fdca896'} Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5ef7fded-bad3-4c9a-b933-94a88fdca896. Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:31:33.762816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d is not attached to volume 5ef7fded-bad3-4c9a-b933-94a88fdca896 Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d is not attached to volume 5ef7fded-bad3-4c9a-b933-94a88fdca896 Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:33.763940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0fe651fa-1426-43d1-b3a6-66e7439f2962 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Returning 404 to user: Instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d is not attached to volume 5ef7fded-bad3-4c9a-b933-94a88fdca896 {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:31:33.765008 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0fe651fa-1426-43d1-b3a6-66e7439f2962 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/os-volume_attachments/5ef7fded-bad3-4c9a-b933-94a88fdca896" status: 404 len: 154 microversion: 2.1 time: 0.209658 Sep 15 19:31:33.765008 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 347/616] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 15 19:31:33 2022] DELETE /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d/os-volume_attachments/5ef7fded-bad3-4c9a-b933-94a88fdca896 => generated 154 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:31:35.045364 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-18fbacf5-3345-452a-94a6-1baabee8c2b4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:35.045945 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-18fbacf5-3345-452a-94a6-1baabee8c2b4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:35.052709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18fbacf5-3345-452a-94a6-1baabee8c2b4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:35.053187 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18fbacf5-3345-452a-94a6-1baabee8c2b4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:35.053653 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18fbacf5-3345-452a-94a6-1baabee8c2b4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:35.054343 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18fbacf5-3345-452a-94a6-1baabee8c2b4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:35.054794 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18fbacf5-3345-452a-94a6-1baabee8c2b4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:35.055216 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18fbacf5-3345-452a-94a6-1baabee8c2b4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:35.082338 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-18fbacf5-3345-452a-94a6-1baabee8c2b4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:31:35.085270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:35.379514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-18fbacf5-3345-452a-94a6-1baabee8c2b4 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 204 len: 0 microversion: 2.1 time: 0.338350 Sep 15 19:31:35.380064 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 348/617] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:31:35 2022] DELETE /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 19:31:35.389022 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-70012ba3-8cd4-4707-81ba-bfe0bad3ef88 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:35.389727 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-70012ba3-8cd4-4707-81ba-bfe0bad3ef88 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:35.395720 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70012ba3-8cd4-4707-81ba-bfe0bad3ef88 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:35.396200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70012ba3-8cd4-4707-81ba-bfe0bad3ef88 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:35.396636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70012ba3-8cd4-4707-81ba-bfe0bad3ef88 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:35.397323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70012ba3-8cd4-4707-81ba-bfe0bad3ef88 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:35.397770 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70012ba3-8cd4-4707-81ba-bfe0bad3ef88 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:35.398189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70012ba3-8cd4-4707-81ba-bfe0bad3ef88 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:35.536030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-70012ba3-8cd4-4707-81ba-bfe0bad3ef88 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:35.543921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-70012ba3-8cd4-4707-81ba-bfe0bad3ef88 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1552 microversion: 2.1 time: 0.159385 Sep 15 19:31:35.544480 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 349/618] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:35 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:35.867342 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-679f1434-3baa-4c6a-aff4-cbd06b465b3a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9570cb6-2239-41f9-b3ff-13ef18761b26", "device": "/dev/sdb"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:35.871011 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-679f1434-3baa-4c6a-aff4-cbd06b465b3a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:35.878093 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-679f1434-3baa-4c6a-aff4-cbd06b465b3a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:35.878569 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-679f1434-3baa-4c6a-aff4-cbd06b465b3a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:35.879001 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-679f1434-3baa-4c6a-aff4-cbd06b465b3a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:35.879721 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-679f1434-3baa-4c6a-aff4-cbd06b465b3a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:35.880189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-679f1434-3baa-4c6a-aff4-cbd06b465b3a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:35.880585 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-679f1434-3baa-4c6a-aff4-cbd06b465b3a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:38.006045 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-679f1434-3baa-4c6a-aff4-cbd06b465b3a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "POST /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.143039 Sep 15 19:31:38.013143 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 350/619] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:31:35 2022] POST /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a/os-volume_attachments => generated 194 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:31:38.013143 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-efa25bda-1d92-4eac-b673-0ceff59f091b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:38.016310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-efa25bda-1d92-4eac-b673-0ceff59f091b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:38.023904 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-efa25bda-1d92-4eac-b673-0ceff59f091b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:38.025060 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-efa25bda-1d92-4eac-b673-0ceff59f091b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:38.025821 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-efa25bda-1d92-4eac-b673-0ceff59f091b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:38.026953 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-efa25bda-1d92-4eac-b673-0ceff59f091b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:38.027709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-efa25bda-1d92-4eac-b673-0ceff59f091b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:38.031923 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-efa25bda-1d92-4eac-b673-0ceff59f091b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:38.262374 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-efa25bda-1d92-4eac-b673-0ceff59f091b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:38.270862 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-efa25bda-1d92-4eac-b673-0ceff59f091b tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1552 microversion: 2.1 time: 0.262856 Sep 15 19:31:38.271439 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 351/620] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:38 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1552 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:31:38.276177 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-b2ca0a24-72fe-4348-a373-fb1a54097851 req-967d19af-bd90-4032-afd5-abe18c07950f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdce58c-be13-4f4a-8a24-b3f3f002d77d", "name": "network-vif-deleted", "tag": "1d0a2bca-ad01-4592-b8f5-ddac6af30dc4"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:38.286939 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-b2ca0a24-72fe-4348-a373-fb1a54097851 req-967d19af-bd90-4032-afd5-abe18c07950f service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:38.287416 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-b2ca0a24-72fe-4348-a373-fb1a54097851 req-967d19af-bd90-4032-afd5-abe18c07950f service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:38.287890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-b2ca0a24-72fe-4348-a373-fb1a54097851 req-967d19af-bd90-4032-afd5-abe18c07950f service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:38.300576 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-b2ca0a24-72fe-4348-a373-fb1a54097851 req-967d19af-bd90-4032-afd5-abe18c07950f service nova] Creating event network-vif-deleted:1d0a2bca-ad01-4592-b8f5-ddac6af30dc4 for instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d on hv-cinder-84984 Sep 15 19:31:38.305571 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-b2ca0a24-72fe-4348-a373-fb1a54097851 req-967d19af-bd90-4032-afd5-abe18c07950f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032939 Sep 15 19:31:38.306701 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 352/621] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:31:39.296513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:39.297223 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:39.303754 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:39.304251 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:39.304690 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:39.305400 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:39.305858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:39.306287 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:39.340175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:39.341129 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:39.341580 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:39.342052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lazy-loading 'fault' on Instance uuid dfdce58c-be13-4f4a-8a24-b3f3f002d77d {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:31:39.389678 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8d3fe4be354995b1698b9783ce6c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd3f2da26af4d3db4c6db4ceb851558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:31:39.398346 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-502ee8a7-b6c4-4188-9bbe-08d4ce539e80 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 200 len: 1347 microversion: 2.1 time: 0.107425 Sep 15 19:31:39.398930 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 353/622] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:39 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 1347 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:31:40.422739 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8c50b650-e68d-4b7b-a0d2-bc1b551889f8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:40.423411 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8c50b650-e68d-4b7b-a0d2-bc1b551889f8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] [instance: dfdce58c-be13-4f4a-8a24-b3f3f002d77d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:40.429823 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c50b650-e68d-4b7b-a0d2-bc1b551889f8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:40.430306 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c50b650-e68d-4b7b-a0d2-bc1b551889f8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:40.430756 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c50b650-e68d-4b7b-a0d2-bc1b551889f8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:40.431464 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c50b650-e68d-4b7b-a0d2-bc1b551889f8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:40.431933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c50b650-e68d-4b7b-a0d2-bc1b551889f8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:40.432357 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c50b650-e68d-4b7b-a0d2-bc1b551889f8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:40.446004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-8c50b650-e68d-4b7b-a0d2-bc1b551889f8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] HTTP exception thrown: Instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d could not be found. Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8c50b650-e68d-4b7b-a0d2-bc1b551889f8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Request method failure captured: Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d HTTP/1.1 Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3ztPsXtBUQbHZRpfguPDEveaGKsNv7AbmKy_wON75MqfDpmwkGEJkvQlBQqi_Fe8mUJah7sQ6LMX8TMGoV2s_n20Lha31iaNZloplCaJ0U6nJHLD_xAl82H_uSgBdDYQMtZumCdzc8nbM-cnn6v7LIKuzBA7-XMaMtMTKLWFUZEVek Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 4fd3f2da26af4d3db4c6db4ceb851558 Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-TestMinimumBasicScenario-875696926 Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:31:40.447549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:31:40.449102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4fd3f2da26af4d3db4c6db4ceb851558", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4fd3f2da26af4d3db4c6db4ceb851558"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4fd3f2da26af4d3db4c6db4ceb851558"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4fd3f2da26af4d3db4c6db4ceb851558"}]}] Sep 15 19:31:40.449102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-TestMinimumBasicScenario-875696926 Sep 15 19:31:40.449102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 4fd3f2da26af4d3db4c6db4ceb851558 Sep 15 19:31:40.449102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-TestMinimumBasicScenario-875696926 Sep 15 19:31:40.449102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-TestMinimumBasicScenario-875696926-project Sep 15 19:31:40.449102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:31:40.449102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:31:40.449102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: fd8d3fe4be354995b1698b9783ce6c65 Sep 15 19:31:40.449102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-TestMinimumBasicScenario-875696926-project Sep 15 19:31:40.449102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:31:40.449102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d could not be found. Sep 15 19:31:40.449102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'dfdce58c-be13-4f4a-8a24-b3f3f002d77d'} Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d could not be found. Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:31:40.449890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d could not be found. Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d could not be found. Sep 15 19:31:40.451888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:31:40.453151 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8c50b650-e68d-4b7b-a0d2-bc1b551889f8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Returning 404 to user: Instance dfdce58c-be13-4f4a-8a24-b3f3f002d77d could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:31:40.453151 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8c50b650-e68d-4b7b-a0d2-bc1b551889f8 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d" status: 404 len: 111 microversion: 2.1 time: 0.030855 Sep 15 19:31:40.453151 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 354/623] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:31:40 2022] GET /compute/v2.1/servers/dfdce58c-be13-4f4a-8a24-b3f3f002d77d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:31:40.457933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-55c2f741-f1c1-4008-970d-a6dde55e8550 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] Calling method '.version_select at 0x7f551ea60d30>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:40.522795 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-55c2f741-f1c1-4008-970d-a6dde55e8550 tempest-TestMinimumBasicScenario-875696926 tempest-TestMinimumBasicScenario-875696926-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-157560746" status: 202 len: 0 microversion: 2.1 time: 0.068411 Sep 15 19:31:40.523407 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 355/624] 10.222.0.18 () {58 vars in 1269 bytes} [Thu Sep 15 19:31:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-157560746 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 19:31:57.330155 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:57.332228 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:31:57.523769 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-61a15f5d-caaa-4289-9b65-dbc4a6126361 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:31:57.524273 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-61a15f5d-caaa-4289-9b65-dbc4a6126361 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:57.534037 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-61a15f5d-caaa-4289-9b65-dbc4a6126361 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:57.534541 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-61a15f5d-caaa-4289-9b65-dbc4a6126361 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:57.534988 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-61a15f5d-caaa-4289-9b65-dbc4a6126361 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:57.535744 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-61a15f5d-caaa-4289-9b65-dbc4a6126361 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:57.536194 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-61a15f5d-caaa-4289-9b65-dbc4a6126361 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:57.536631 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-61a15f5d-caaa-4289-9b65-dbc4a6126361 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:57.566715 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-61a15f5d-caaa-4289-9b65-dbc4a6126361 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/ips" status: 200 len: 149 microversion: 2.1 time: 0.244685 Sep 15 19:31:57.567934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 356/625] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 15 19:31:57 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/ips => generated 149 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:31:59.468062 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0a31d7bb-a1e3-4267-b3dc-f5a3f300de2b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1511d37-5578-418e-ad13-943c59cad891"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:31:59.474826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0a31d7bb-a1e3-4267-b3dc-f5a3f300de2b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:31:59.503482 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a31d7bb-a1e3-4267-b3dc-f5a3f300de2b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:59.504114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a31d7bb-a1e3-4267-b3dc-f5a3f300de2b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:59.504536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a31d7bb-a1e3-4267-b3dc-f5a3f300de2b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:31:59.505270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a31d7bb-a1e3-4267-b3dc-f5a3f300de2b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:31:59.505725 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a31d7bb-a1e3-4267-b3dc-f5a3f300de2b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:31:59.506269 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a31d7bb-a1e3-4267-b3dc-f5a3f300de2b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:00.340218 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0a31d7bb-a1e3-4267-b3dc-f5a3f300de2b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "POST /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.877656 Sep 15 19:32:00.346950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 357/626] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:31:59 2022] POST /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments => generated 194 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:32:00.352915 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c2f1f454-56bd-4b04-869e-008279347a7c tempest-TestVolumeBootPattern-514337844 tempest-TestVolumeBootPattern-514337844-project] Calling method '.version_select at 0x7f551ea603a0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:00.442171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c2f1f454-56bd-4b04-869e-008279347a7c tempest-TestVolumeBootPattern-514337844 tempest-TestVolumeBootPattern-514337844-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1611656672" status: 202 len: 0 microversion: 2.1 time: 0.093637 Sep 15 19:32:00.443141 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 358/627] 10.222.0.18 () {58 vars in 1263 bytes} [Thu Sep 15 19:32:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1611656672 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:32:03.199444 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ea706fb3-2667-4b11-891f-39fe241eacf1 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:03.200419 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ea706fb3-2667-4b11-891f-39fe241eacf1 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:03.217954 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea706fb3-2667-4b11-891f-39fe241eacf1 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:03.228659 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea706fb3-2667-4b11-891f-39fe241eacf1 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:03.229496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea706fb3-2667-4b11-891f-39fe241eacf1 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:03.232783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea706fb3-2667-4b11-891f-39fe241eacf1 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:03.233443 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea706fb3-2667-4b11-891f-39fe241eacf1 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:03.233882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea706fb3-2667-4b11-891f-39fe241eacf1 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:03.397476 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-ea706fb3-2667-4b11-891f-39fe241eacf1 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lazy-loading 'services' on Instance uuid b678c560-1f6f-4615-9a4b-b700d59aed1a {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:32:03.770513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ea706fb3-2667-4b11-891f-39fe241eacf1 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a/os-volume_attachments/b9570cb6-2239-41f9-b3ff-13ef18761b26" status: 202 len: 0 microversion: 2.1 time: 0.575444 Sep 15 19:32:03.775695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 359/628] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 15 19:32:03 2022] DELETE /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a/os-volume_attachments/b9570cb6-2239-41f9-b3ff-13ef18761b26 => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:32:08.145165 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-051a9206-cb9e-4567-8daf-033c1f30ca93 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Action: 'create', calling method: .version_select at 0x7f551ea3b040>, body: {"keypair": {"name": "tempest-TestShelveInstance-263373816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeOdoMUIPNIGo3Huo/dNDOGnZGH0IchyIbUrzO/34qQjQig9y9WEmMYs5ryNTQGXvp4FK/toQ4839EClffxkgnk8tGIKaKn8CgUep1L0HVgb/tZOH89zhmmi5fRlIbQdQ=="}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:08.188102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-051a9206-cb9e-4567-8daf-033c1f30ca93 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Getting quotas for project a7bbec449c0142f0b910956bacedbe5e. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:32:08.196147 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-051a9206-cb9e-4567-8daf-033c1f30ca93 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Getting quotas for user b638c6d935e64be6bce4ecc1fb8f26ec and project a7bbec449c0142f0b910956bacedbe5e. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:32:08.346142 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-051a9206-cb9e-4567-8daf-033c1f30ca93 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.461910 Sep 15 19:32:08.351031 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 360/629] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 15 19:32:07 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:08.449411 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7b44b319-80a6-47a5-b791-cf316cdd4c1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1511d37-5578-418e-ad13-943c59cad891"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:08.456322 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7b44b319-80a6-47a5-b791-cf316cdd4c1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:08.464083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b44b319-80a6-47a5-b791-cf316cdd4c1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:08.464675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b44b319-80a6-47a5-b791-cf316cdd4c1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:08.465367 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b44b319-80a6-47a5-b791-cf316cdd4c1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:08.466866 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b44b319-80a6-47a5-b791-cf316cdd4c1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:08.467570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b44b319-80a6-47a5-b791-cf316cdd4c1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:08.468262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b44b319-80a6-47a5-b791-cf316cdd4c1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:08.577398 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-7b44b319-80a6-47a5-b791-cf316cdd4c1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Invalid volume: volume b1511d37-5578-418e-ad13-943c59cad891 is already attached to instances: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7b44b319-80a6-47a5-b791-cf316cdd4c1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: POST /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments HTTP/1.1 Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 74 Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:32:08.579168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:32:08.581483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:32:08.581483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:32:08.581483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:32:08.581483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:32:08.581483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:32:08.581483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:32:08.581483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:32:08.581483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:32:08.581483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:32:08.581483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Sep 15 19:32:08.581483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {"volumeAttachment": {"volumeId": "b1511d37-5578-418e-ad13-943c59cad891"}} Sep 15 19:32:08.581483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Invalid volume: volume b1511d37-5578-418e-ad13-943c59cad891 is already attached to instances: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'server_id': '958ffdf6-6239-4d43-a0ba-0769a4b3cfa4', 'body': {'volumeAttachment': {'volumeId': 'b1511d37-5578-418e-ad13-943c59cad891'}}} Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b1511d37-5578-418e-ad13-943c59cad891 is already attached to instances: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:08.582232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b1511d37-5578-418e-ad13-943c59cad891 is already attached to instances: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:08.583418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:08.585315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:08.585315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:32:08.585315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:32:08.585315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b1511d37-5578-418e-ad13-943c59cad891 is already attached to instances: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 Sep 15 19:32:08.585315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:08.585315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7b44b319-80a6-47a5-b791-cf316cdd4c1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 400 to user: Invalid volume: volume b1511d37-5578-418e-ad13-943c59cad891 is already attached to instances: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:32:08.585315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7b44b319-80a6-47a5-b791-cf316cdd4c1b tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "POST /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135371 Sep 15 19:32:08.585315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 361/630] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:32:08 2022] POST /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments => generated 174 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 19:32:08.666664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b968d1c2-603e-49c1-9bd2-38cc12aeb50a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:08.668182 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b968d1c2-603e-49c1-9bd2-38cc12aeb50a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:08.676154 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b968d1c2-603e-49c1-9bd2-38cc12aeb50a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:08.677581 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b968d1c2-603e-49c1-9bd2-38cc12aeb50a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:08.678550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b968d1c2-603e-49c1-9bd2-38cc12aeb50a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:08.680078 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b968d1c2-603e-49c1-9bd2-38cc12aeb50a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:08.680965 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b968d1c2-603e-49c1-9bd2-38cc12aeb50a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:08.681614 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b968d1c2-603e-49c1-9bd2-38cc12aeb50a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:08.798869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-b968d1c2-603e-49c1-9bd2-38cc12aeb50a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lazy-loading 'services' on Instance uuid 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:32:09.101213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b968d1c2-603e-49c1-9bd2-38cc12aeb50a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments/b1511d37-5578-418e-ad13-943c59cad891" status: 202 len: 0 microversion: 2.1 time: 0.438998 Sep 15 19:32:09.102240 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 362/631] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 15 19:32:08 2022] DELETE /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments/b1511d37-5578-418e-ad13-943c59cad891 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:32:09.120144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8819a8cb-467d-4bb9-85b7-87a6986200d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:09.126642 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8819a8cb-467d-4bb9-85b7-87a6986200d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:09.135993 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8819a8cb-467d-4bb9-85b7-87a6986200d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:09.136800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8819a8cb-467d-4bb9-85b7-87a6986200d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:09.137425 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8819a8cb-467d-4bb9-85b7-87a6986200d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:09.140389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8819a8cb-467d-4bb9-85b7-87a6986200d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:09.141081 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8819a8cb-467d-4bb9-85b7-87a6986200d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:09.141707 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8819a8cb-467d-4bb9-85b7-87a6986200d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:09.232314 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8819a8cb-467d-4bb9-85b7-87a6986200d4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102085 Sep 15 19:32:09.240488 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 363/632] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:32:09 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:09.479937 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-44a236b6-92a4-4157-b4e4-24211e490a55 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:09.480560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-44a236b6-92a4-4157-b4e4-24211e490a55 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:09.488061 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44a236b6-92a4-4157-b4e4-24211e490a55 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:09.488984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44a236b6-92a4-4157-b4e4-24211e490a55 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:09.489889 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44a236b6-92a4-4157-b4e4-24211e490a55 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:09.490777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44a236b6-92a4-4157-b4e4-24211e490a55 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:09.491565 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44a236b6-92a4-4157-b4e4-24211e490a55 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:09.492324 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-44a236b6-92a4-4157-b4e4-24211e490a55 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:09.546725 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-44a236b6-92a4-4157-b4e4-24211e490a55 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:32:10.048211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-44a236b6-92a4-4157-b4e4-24211e490a55 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 204 len: 0 microversion: 2.1 time: 0.572967 Sep 15 19:32:10.049081 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 364/633] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:32:09 2022] DELETE /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 19:32:10.061164 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d9b8e793-e8ce-48f4-9ee6-01febd9c6721 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:10.062019 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d9b8e793-e8ce-48f4-9ee6-01febd9c6721 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:10.070829 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9b8e793-e8ce-48f4-9ee6-01febd9c6721 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:10.071692 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9b8e793-e8ce-48f4-9ee6-01febd9c6721 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:10.073212 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9b8e793-e8ce-48f4-9ee6-01febd9c6721 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:10.074245 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9b8e793-e8ce-48f4-9ee6-01febd9c6721 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:10.075303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9b8e793-e8ce-48f4-9ee6-01febd9c6721 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:10.077253 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9b8e793-e8ce-48f4-9ee6-01febd9c6721 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:10.260142 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d9b8e793-e8ce-48f4-9ee6-01febd9c6721 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:10.288198 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d9b8e793-e8ce-48f4-9ee6-01febd9c6721 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1514 microversion: 2.1 time: 0.218946 Sep 15 19:32:10.288198 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 365/634] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:10 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:10.288198 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-deaf02b3-bd2a-4b6e-9972-245dfa43f4be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:10.288198 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-deaf02b3-bd2a-4b6e-9972-245dfa43f4be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:10.293092 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-deaf02b3-bd2a-4b6e-9972-245dfa43f4be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:10.293695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-deaf02b3-bd2a-4b6e-9972-245dfa43f4be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:10.294222 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-deaf02b3-bd2a-4b6e-9972-245dfa43f4be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:10.295049 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-deaf02b3-bd2a-4b6e-9972-245dfa43f4be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:10.295576 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-deaf02b3-bd2a-4b6e-9972-245dfa43f4be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:10.296101 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-deaf02b3-bd2a-4b6e-9972-245dfa43f4be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:10.334490 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-deaf02b3-bd2a-4b6e-9972-245dfa43f4be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055874 Sep 15 19:32:10.335092 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 366/635] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:32:10 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:11.307978 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c6ef256f-7d2b-4848-9742-f4d46a34a7fe tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:11.308832 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c6ef256f-7d2b-4848-9742-f4d46a34a7fe tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:11.316087 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c6ef256f-7d2b-4848-9742-f4d46a34a7fe tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:11.316791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c6ef256f-7d2b-4848-9742-f4d46a34a7fe tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:11.317232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c6ef256f-7d2b-4848-9742-f4d46a34a7fe tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:11.317999 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c6ef256f-7d2b-4848-9742-f4d46a34a7fe tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:11.318506 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c6ef256f-7d2b-4848-9742-f4d46a34a7fe tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:11.318934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c6ef256f-7d2b-4848-9742-f4d46a34a7fe tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:11.634270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c6ef256f-7d2b-4848-9742-f4d46a34a7fe tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:11.652353 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c6ef256f-7d2b-4848-9742-f4d46a34a7fe tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1514 microversion: 2.1 time: 0.340102 Sep 15 19:32:11.653418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 367/636] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:11 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1514 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:11.658415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0ac9a9a5-59ca-44a5-b677-108b28e9e191 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:11.666488 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0ac9a9a5-59ca-44a5-b677-108b28e9e191 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:11.686441 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ac9a9a5-59ca-44a5-b677-108b28e9e191 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:11.691285 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ac9a9a5-59ca-44a5-b677-108b28e9e191 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:11.698168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ac9a9a5-59ca-44a5-b677-108b28e9e191 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:11.699045 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ac9a9a5-59ca-44a5-b677-108b28e9e191 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:11.699540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ac9a9a5-59ca-44a5-b677-108b28e9e191 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:11.702354 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ac9a9a5-59ca-44a5-b677-108b28e9e191 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:11.752986 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0ac9a9a5-59ca-44a5-b677-108b28e9e191 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098583 Sep 15 19:32:11.759223 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 368/637] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:32:11 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:11.921433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8640b0bd-568a-4114-b62e-7c9cf7a65972 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:11.921942 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8640b0bd-568a-4114-b62e-7c9cf7a65972 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:11.928934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8640b0bd-568a-4114-b62e-7c9cf7a65972 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:11.929432 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8640b0bd-568a-4114-b62e-7c9cf7a65972 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:11.929873 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8640b0bd-568a-4114-b62e-7c9cf7a65972 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:11.930584 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8640b0bd-568a-4114-b62e-7c9cf7a65972 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:11.931034 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8640b0bd-568a-4114-b62e-7c9cf7a65972 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:11.931769 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8640b0bd-568a-4114-b62e-7c9cf7a65972 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:12.065872 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-8640b0bd-568a-4114-b62e-7c9cf7a65972 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lazy-loading 'services' on Instance uuid 212105c1-8435-430c-9ffa-72e8a6bd2426 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:32:12.215619 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=5 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:12.384952 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8640b0bd-568a-4114-b62e-7c9cf7a65972 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "DELETE /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-volume_attachments/d52f6d82-8f48-4628-9d06-87743c7c0912" status: 202 len: 0 microversion: 2.1 time: 0.475412 Sep 15 19:32:12.387901 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 369/638] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 15 19:32:11 2022] DELETE /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-volume_attachments/d52f6d82-8f48-4628-9d06-87743c7c0912 => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 19:32:12.400159 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f2ea6fb9-c7e5-435a-b4d2-6d4680289d09 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:12.413899 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f2ea6fb9-c7e5-435a-b4d2-6d4680289d09 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:12.423254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2ea6fb9-c7e5-435a-b4d2-6d4680289d09 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:12.423775 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2ea6fb9-c7e5-435a-b4d2-6d4680289d09 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:12.424215 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2ea6fb9-c7e5-435a-b4d2-6d4680289d09 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:12.424919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2ea6fb9-c7e5-435a-b4d2-6d4680289d09 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:12.425373 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2ea6fb9-c7e5-435a-b4d2-6d4680289d09 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:12.425797 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2ea6fb9-c7e5-435a-b4d2-6d4680289d09 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:12.487965 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f2ea6fb9-c7e5-435a-b4d2-6d4680289d09 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095688 Sep 15 19:32:12.492707 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 370/639] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:32:12 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:12.693406 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-1221ba82-767e-4aa4-adc4-195d4106211f req-61b5eaf2-3f56-4211-8243-471071240f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b678c560-1f6f-4615-9a4b-b700d59aed1a", "name": "network-vif-deleted", "tag": "f243b1f2-796e-4006-82ce-c3b9f6bb805f"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:12.705178 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-1221ba82-767e-4aa4-adc4-195d4106211f req-61b5eaf2-3f56-4211-8243-471071240f92 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:12.705654 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-1221ba82-767e-4aa4-adc4-195d4106211f req-61b5eaf2-3f56-4211-8243-471071240f92 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:12.706136 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-1221ba82-767e-4aa4-adc4-195d4106211f req-61b5eaf2-3f56-4211-8243-471071240f92 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:12.726493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-1221ba82-767e-4aa4-adc4-195d4106211f req-61b5eaf2-3f56-4211-8243-471071240f92 service nova] Creating event network-vif-deleted:f243b1f2-796e-4006-82ce-c3b9f6bb805f for instance b678c560-1f6f-4615-9a4b-b700d59aed1a on hv-cinder-84984 Sep 15 19:32:12.734714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-1221ba82-767e-4aa4-adc4-195d4106211f req-61b5eaf2-3f56-4211-8243-471071240f92 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109008 Sep 15 19:32:12.735442 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 371/640] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:12.742681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-533d5795-3469-40b9-be5f-4cc2644f20e4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:12.742681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-533d5795-3469-40b9-be5f-4cc2644f20e4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:12.751966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-533d5795-3469-40b9-be5f-4cc2644f20e4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:12.752455 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-533d5795-3469-40b9-be5f-4cc2644f20e4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:12.752884 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-533d5795-3469-40b9-be5f-4cc2644f20e4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:12.753616 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-533d5795-3469-40b9-be5f-4cc2644f20e4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:12.754160 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-533d5795-3469-40b9-be5f-4cc2644f20e4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:12.754485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-533d5795-3469-40b9-be5f-4cc2644f20e4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:12.823317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-533d5795-3469-40b9-be5f-4cc2644f20e4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:12.831606 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-533d5795-3469-40b9-be5f-4cc2644f20e4 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1472 microversion: 2.1 time: 0.094940 Sep 15 19:32:12.844657 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 372/641] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:12 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1472 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:12.844657 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8c791df6-24c4-4706-9da9-e2f7be6e1af7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:12.844657 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8c791df6-24c4-4706-9da9-e2f7be6e1af7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:12.847019 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c791df6-24c4-4706-9da9-e2f7be6e1af7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:12.847855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c791df6-24c4-4706-9da9-e2f7be6e1af7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:12.848630 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c791df6-24c4-4706-9da9-e2f7be6e1af7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:12.849644 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c791df6-24c4-4706-9da9-e2f7be6e1af7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:12.850093 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c791df6-24c4-4706-9da9-e2f7be6e1af7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:12.850712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c791df6-24c4-4706-9da9-e2f7be6e1af7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:12.889338 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8c791df6-24c4-4706-9da9-e2f7be6e1af7 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054175 Sep 15 19:32:12.902301 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 373/642] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:32:12 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 19:32:13.008986 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5948c4f3-5daa-46d6-8bfd-0676f213c3b8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:13.011913 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5948c4f3-5daa-46d6-8bfd-0676f213c3b8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:13.020512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5948c4f3-5daa-46d6-8bfd-0676f213c3b8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:13.022424 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5948c4f3-5daa-46d6-8bfd-0676f213c3b8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:13.022950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5948c4f3-5daa-46d6-8bfd-0676f213c3b8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:13.024088 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5948c4f3-5daa-46d6-8bfd-0676f213c3b8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:13.024556 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5948c4f3-5daa-46d6-8bfd-0676f213c3b8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:13.024987 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5948c4f3-5daa-46d6-8bfd-0676f213c3b8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:13.052709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5948c4f3-5daa-46d6-8bfd-0676f213c3b8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:32:13.662872 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5948c4f3-5daa-46d6-8bfd-0676f213c3b8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 204 len: 0 microversion: 2.1 time: 0.664329 Sep 15 19:32:13.664701 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 374/643] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:32:12 2022] DELETE /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 19:32:13.672580 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c0dbf639-58a8-4460-a542-297260c2deba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:13.675592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c0dbf639-58a8-4460-a542-297260c2deba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:13.684189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0dbf639-58a8-4460-a542-297260c2deba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:13.685620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0dbf639-58a8-4460-a542-297260c2deba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:13.686249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0dbf639-58a8-4460-a542-297260c2deba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:13.687217 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0dbf639-58a8-4460-a542-297260c2deba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:13.687914 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0dbf639-58a8-4460-a542-297260c2deba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:13.688343 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0dbf639-58a8-4460-a542-297260c2deba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:13.719610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c0dbf639-58a8-4460-a542-297260c2deba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053357 Sep 15 19:32:13.720201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 375/644] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:32:13 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:13.724571 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a1b244c0-e1ca-4ecf-bf93-68dc985117fc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:13.725178 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a1b244c0-e1ca-4ecf-bf93-68dc985117fc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:13.731048 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1b244c0-e1ca-4ecf-bf93-68dc985117fc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:13.731538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1b244c0-e1ca-4ecf-bf93-68dc985117fc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:13.732537 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1b244c0-e1ca-4ecf-bf93-68dc985117fc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:13.733756 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1b244c0-e1ca-4ecf-bf93-68dc985117fc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:13.733756 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1b244c0-e1ca-4ecf-bf93-68dc985117fc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:13.734074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1b244c0-e1ca-4ecf-bf93-68dc985117fc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:13.889785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a1b244c0-e1ca-4ecf-bf93-68dc985117fc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:13.897635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a1b244c0-e1ca-4ecf-bf93-68dc985117fc tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1682 microversion: 2.1 time: 0.176467 Sep 15 19:32:13.898201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 376/645] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:13 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:13.902872 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:13.903476 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:13.915759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:13.916262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:13.925385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:13.925385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:13.925385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:13.925385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:13.957433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:13.957912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:13.958341 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:13.958846 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lazy-loading 'fault' on Instance uuid b678c560-1f6f-4615-9a4b-b700d59aed1a {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:32:14.001979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:14.016740 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-75606223-e500-498f-ab48-de31072d7ba2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1309 microversion: 2.1 time: 0.112156 Sep 15 19:32:14.016740 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 377/646] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:13 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:14.733913 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d8c22855-3929-43d3-8b8f-e324bd99caa3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:14.736507 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d8c22855-3929-43d3-8b8f-e324bd99caa3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:14.742983 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d8c22855-3929-43d3-8b8f-e324bd99caa3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:14.743857 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d8c22855-3929-43d3-8b8f-e324bd99caa3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:14.744303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d8c22855-3929-43d3-8b8f-e324bd99caa3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:14.745023 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d8c22855-3929-43d3-8b8f-e324bd99caa3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:14.745478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d8c22855-3929-43d3-8b8f-e324bd99caa3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:14.745959 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d8c22855-3929-43d3-8b8f-e324bd99caa3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:14.779255 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d8c22855-3929-43d3-8b8f-e324bd99caa3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050461 Sep 15 19:32:14.779914 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 378/647] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:32:14 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 19:32:14.865727 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9a10aa84-3d17-4ef3-a828-3f73b316635b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:14.866444 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9a10aa84-3d17-4ef3-a828-3f73b316635b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:14.875900 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a10aa84-3d17-4ef3-a828-3f73b316635b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:14.876756 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a10aa84-3d17-4ef3-a828-3f73b316635b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:14.880265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a10aa84-3d17-4ef3-a828-3f73b316635b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:14.880265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a10aa84-3d17-4ef3-a828-3f73b316635b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:14.880265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a10aa84-3d17-4ef3-a828-3f73b316635b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:14.880265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a10aa84-3d17-4ef3-a828-3f73b316635b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:14.920117 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9a10aa84-3d17-4ef3-a828-3f73b316635b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:32:15.499536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9a10aa84-3d17-4ef3-a828-3f73b316635b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "DELETE /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 204 len: 0 microversion: 2.1 time: 0.638522 Sep 15 19:32:15.500163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 379/648] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:32:14 2022] DELETE /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 19:32:15.505738 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cf305f5f-e993-4eb4-af91-466ef9cf4daf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:15.506433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cf305f5f-e993-4eb4-af91-466ef9cf4daf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:15.512373 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf305f5f-e993-4eb4-af91-466ef9cf4daf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:15.512846 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf305f5f-e993-4eb4-af91-466ef9cf4daf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:15.513274 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf305f5f-e993-4eb4-af91-466ef9cf4daf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:15.513997 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf305f5f-e993-4eb4-af91-466ef9cf4daf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:15.514441 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf305f5f-e993-4eb4-af91-466ef9cf4daf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:15.514855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf305f5f-e993-4eb4-af91-466ef9cf4daf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:15.699032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cf305f5f-e993-4eb4-af91-466ef9cf4daf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:15.714965 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cf305f5f-e993-4eb4-af91-466ef9cf4daf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1682 microversion: 2.1 time: 0.213498 Sep 15 19:32:15.715549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 380/649] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:15 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:15.722494 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:15.723178 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:15.732390 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:15.732942 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:15.733513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:15.734218 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:15.734727 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:15.735216 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:15.770413 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:15.770894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:15.771324 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:15.771803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lazy-loading 'fault' on Instance uuid b678c560-1f6f-4615-9a4b-b700d59aed1a {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:32:15.814449 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:15.822263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a2fecca8-184c-4de8-9937-dc911b2c9c85 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1309 microversion: 2.1 time: 0.104539 Sep 15 19:32:15.822825 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 381/650] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:15 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:15.827789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e4d2203d-ffc3-49f1-a5cd-1ae0ff5f7ec7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:15.828392 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e4d2203d-ffc3-49f1-a5cd-1ae0ff5f7ec7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:15.833958 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4d2203d-ffc3-49f1-a5cd-1ae0ff5f7ec7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:15.834432 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4d2203d-ffc3-49f1-a5cd-1ae0ff5f7ec7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:15.834860 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4d2203d-ffc3-49f1-a5cd-1ae0ff5f7ec7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:15.835538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4d2203d-ffc3-49f1-a5cd-1ae0ff5f7ec7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:15.836014 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4d2203d-ffc3-49f1-a5cd-1ae0ff5f7ec7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:15.836434 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4d2203d-ffc3-49f1-a5cd-1ae0ff5f7ec7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:15.975120 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e4d2203d-ffc3-49f1-a5cd-1ae0ff5f7ec7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:15.985005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e4d2203d-ffc3-49f1-a5cd-1ae0ff5f7ec7 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1688 microversion: 2.1 time: 0.161136 Sep 15 19:32:15.985586 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 382/651] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:15 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:16.744133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-69ef648c-754c-4337-819b-ac21da1069b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:16.744870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-69ef648c-754c-4337-819b-ac21da1069b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:16.752450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69ef648c-754c-4337-819b-ac21da1069b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:16.752939 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69ef648c-754c-4337-819b-ac21da1069b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:16.753376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69ef648c-754c-4337-819b-ac21da1069b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:16.754082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69ef648c-754c-4337-819b-ac21da1069b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:16.754536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69ef648c-754c-4337-819b-ac21da1069b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:16.754961 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69ef648c-754c-4337-819b-ac21da1069b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:16.759468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:16.895231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-69ef648c-754c-4337-819b-ac21da1069b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:16.903302 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-69ef648c-754c-4337-819b-ac21da1069b5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1682 microversion: 2.1 time: 0.163198 Sep 15 19:32:16.904404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 383/652] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:16 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:16.909376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:16.911345 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:16.918356 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:16.918951 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:16.920185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:16.921067 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:16.921525 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:16.921954 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:16.956135 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:16.956605 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:16.957125 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:16.957576 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lazy-loading 'fault' on Instance uuid b678c560-1f6f-4615-9a4b-b700d59aed1a {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:32:17.003073 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:17.010866 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a762790a-874a-4f96-ace0-c87eb60a4c41 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1309 microversion: 2.1 time: 0.105488 Sep 15 19:32:17.011436 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 384/653] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:16 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:17.016054 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-05668d2e-0140-4283-9479-8e52f6857c3b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:17.016672 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-05668d2e-0140-4283-9479-8e52f6857c3b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:17.022627 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05668d2e-0140-4283-9479-8e52f6857c3b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:17.023114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05668d2e-0140-4283-9479-8e52f6857c3b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:17.023547 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05668d2e-0140-4283-9479-8e52f6857c3b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:17.024273 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05668d2e-0140-4283-9479-8e52f6857c3b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:17.024728 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05668d2e-0140-4283-9479-8e52f6857c3b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:17.025150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05668d2e-0140-4283-9479-8e52f6857c3b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:17.159568 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-05668d2e-0140-4283-9479-8e52f6857c3b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:17.168062 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-05668d2e-0140-4283-9479-8e52f6857c3b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1688 microversion: 2.1 time: 0.155606 Sep 15 19:32:17.168949 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 385/654] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:17 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:17.928600 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-43a830bb-6a78-4d71-abce-31f63251392f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:17.929214 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-43a830bb-6a78-4d71-abce-31f63251392f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:17.938550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-43a830bb-6a78-4d71-abce-31f63251392f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:17.939037 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-43a830bb-6a78-4d71-abce-31f63251392f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:17.939482 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-43a830bb-6a78-4d71-abce-31f63251392f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:17.940222 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-43a830bb-6a78-4d71-abce-31f63251392f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:17.940667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-43a830bb-6a78-4d71-abce-31f63251392f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:17.941124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-43a830bb-6a78-4d71-abce-31f63251392f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:18.080772 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-43a830bb-6a78-4d71-abce-31f63251392f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:18.088964 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-43a830bb-6a78-4d71-abce-31f63251392f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1682 microversion: 2.1 time: 0.164497 Sep 15 19:32:18.089570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 386/655] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:17 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:18.094440 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:18.095108 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:18.098322 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:18.101774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:18.102162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:18.102594 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:18.103290 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:18.103772 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:18.104203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:18.138926 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:18.139400 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:18.139893 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:18.140449 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lazy-loading 'fault' on Instance uuid b678c560-1f6f-4615-9a4b-b700d59aed1a {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:32:18.186718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:18.194777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b6e264bb-67ed-41c0-9fda-d97993b53922 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 200 len: 1309 microversion: 2.1 time: 0.104233 Sep 15 19:32:18.195349 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 387/656] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:18 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:18.199897 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0e0552e0-f0bd-4c68-aa58-9dfc650adaf4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:18.200534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0e0552e0-f0bd-4c68-aa58-9dfc650adaf4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:18.205184 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=4 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:18.207008 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e0552e0-f0bd-4c68-aa58-9dfc650adaf4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:18.207483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e0552e0-f0bd-4c68-aa58-9dfc650adaf4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:18.208016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e0552e0-f0bd-4c68-aa58-9dfc650adaf4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:18.208712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e0552e0-f0bd-4c68-aa58-9dfc650adaf4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:18.209164 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e0552e0-f0bd-4c68-aa58-9dfc650adaf4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:18.209587 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e0552e0-f0bd-4c68-aa58-9dfc650adaf4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:18.346141 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0e0552e0-f0bd-4c68-aa58-9dfc650adaf4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:18.354089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0e0552e0-f0bd-4c68-aa58-9dfc650adaf4 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1688 microversion: 2.1 time: 0.157637 Sep 15 19:32:18.354597 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 388/657] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:18 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:18.670133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cff7ad91-e4f7-4af7-ac75-8ca2717991b2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:18.672641 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cff7ad91-e4f7-4af7-ac75-8ca2717991b2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:18.678725 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cff7ad91-e4f7-4af7-ac75-8ca2717991b2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:18.679296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cff7ad91-e4f7-4af7-ac75-8ca2717991b2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:18.679768 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cff7ad91-e4f7-4af7-ac75-8ca2717991b2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:18.680477 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cff7ad91-e4f7-4af7-ac75-8ca2717991b2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:18.680930 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cff7ad91-e4f7-4af7-ac75-8ca2717991b2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:18.681358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cff7ad91-e4f7-4af7-ac75-8ca2717991b2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:18.713349 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cff7ad91-e4f7-4af7-ac75-8ca2717991b2 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047132 Sep 15 19:32:18.713977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 389/658] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:32:18 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 19:32:18.781048 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-054b38d3-5ba1-4f03-9d54-df2ed92ee4da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:18.781547 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-054b38d3-5ba1-4f03-9d54-df2ed92ee4da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:18.788646 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-054b38d3-5ba1-4f03-9d54-df2ed92ee4da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:18.789287 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-054b38d3-5ba1-4f03-9d54-df2ed92ee4da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:18.789730 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-054b38d3-5ba1-4f03-9d54-df2ed92ee4da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:18.790530 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-054b38d3-5ba1-4f03-9d54-df2ed92ee4da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:18.790990 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-054b38d3-5ba1-4f03-9d54-df2ed92ee4da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:18.791416 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-054b38d3-5ba1-4f03-9d54-df2ed92ee4da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:18.818603 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-054b38d3-5ba1-4f03-9d54-df2ed92ee4da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:32:19.157279 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-054b38d3-5ba1-4f03-9d54-df2ed92ee4da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 204 len: 0 microversion: 2.1 time: 0.380512 Sep 15 19:32:19.161208 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 390/659] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:32:18 2022] DELETE /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 19:32:19.165967 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-71d3392f-ac40-4bdf-b39c-a8991d9d14ec tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:19.166768 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-71d3392f-ac40-4bdf-b39c-a8991d9d14ec tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:19.173044 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71d3392f-ac40-4bdf-b39c-a8991d9d14ec tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:19.173644 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71d3392f-ac40-4bdf-b39c-a8991d9d14ec tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:19.174179 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71d3392f-ac40-4bdf-b39c-a8991d9d14ec tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:19.174943 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71d3392f-ac40-4bdf-b39c-a8991d9d14ec tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:19.175829 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71d3392f-ac40-4bdf-b39c-a8991d9d14ec tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:19.176402 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71d3392f-ac40-4bdf-b39c-a8991d9d14ec tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:19.438210 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-71d3392f-ac40-4bdf-b39c-a8991d9d14ec tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:19.446468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-71d3392f-ac40-4bdf-b39c-a8991d9d14ec tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1682 microversion: 2.1 time: 0.286964 Sep 15 19:32:19.447162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 391/660] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:19 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1682 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:19.451869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-08637c00-ac97-4e72-b002-60437b10a78d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:19.452499 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-08637c00-ac97-4e72-b002-60437b10a78d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:19.459284 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08637c00-ac97-4e72-b002-60437b10a78d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:19.460067 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08637c00-ac97-4e72-b002-60437b10a78d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:19.460603 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08637c00-ac97-4e72-b002-60437b10a78d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:19.461402 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08637c00-ac97-4e72-b002-60437b10a78d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:19.461959 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08637c00-ac97-4e72-b002-60437b10a78d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:19.462483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08637c00-ac97-4e72-b002-60437b10a78d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:19.632487 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-08637c00-ac97-4e72-b002-60437b10a78d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:19.640371 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-08637c00-ac97-4e72-b002-60437b10a78d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1674 microversion: 2.1 time: 0.192210 Sep 15 19:32:19.640941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 392/661] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:19 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1674 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:19.646316 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f282ffef-8aad-41a3-8c5d-81f2746011ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:19.646974 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f282ffef-8aad-41a3-8c5d-81f2746011ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: b678c560-1f6f-4615-9a4b-b700d59aed1a] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:19.653041 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f282ffef-8aad-41a3-8c5d-81f2746011ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:19.653924 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f282ffef-8aad-41a3-8c5d-81f2746011ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:19.654066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f282ffef-8aad-41a3-8c5d-81f2746011ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:19.654805 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f282ffef-8aad-41a3-8c5d-81f2746011ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:19.655441 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f282ffef-8aad-41a3-8c5d-81f2746011ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:19.655779 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f282ffef-8aad-41a3-8c5d-81f2746011ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:19.678693 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-f282ffef-8aad-41a3-8c5d-81f2746011ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] HTTP exception thrown: Instance b678c560-1f6f-4615-9a4b-b700d59aed1a could not be found. Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f282ffef-8aad-41a3-8c5d-81f2746011ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Request method failure captured: Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a HTTP/1.1 Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI31zk1GhjObBglpaLLdxpnjrJGxoosgweb9L585hHf2evoiWm46dNRHvrDJui4Ke4OXAwFUJviTiREEPiojrfuJqTLMUz_RorTz-yeTW-ACVt3s5ybtdDUcG2RrvPvLzRkS4oz2uPzV6HKMOzJAuGEZADwe9BSFs52DwQHJcGac3oB8 Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: ee88123fe2e34b02a00baeb6f74869aa Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesSnapshotTestJSON-232021177 Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:32:19.680515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:32:19.682126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee88123fe2e34b02a00baeb6f74869aa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee88123fe2e34b02a00baeb6f74869aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee88123fe2e34b02a00baeb6f74869aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee88123fe2e34b02a00baeb6f74869aa"}]}] Sep 15 19:32:19.682126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesSnapshotTestJSON-232021177 Sep 15 19:32:19.682126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: ee88123fe2e34b02a00baeb6f74869aa Sep 15 19:32:19.682126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-232021177 Sep 15 19:32:19.682126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesSnapshotTestJSON-232021177-project Sep 15 19:32:19.682126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:32:19.682126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:32:19.682126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 8c76463423664f649bd018d853010cad Sep 15 19:32:19.682126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesSnapshotTestJSON-232021177-project Sep 15 19:32:19.682126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:32:19.682126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance b678c560-1f6f-4615-9a4b-b700d59aed1a could not be found. Sep 15 19:32:19.682126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'b678c560-1f6f-4615-9a4b-b700d59aed1a'} Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b678c560-1f6f-4615-9a4b-b700d59aed1a could not be found. Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:32:19.683156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b678c560-1f6f-4615-9a4b-b700d59aed1a could not be found. Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b678c560-1f6f-4615-9a4b-b700d59aed1a could not be found. Sep 15 19:32:19.685074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:19.687338 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f282ffef-8aad-41a3-8c5d-81f2746011ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Returning 404 to user: Instance b678c560-1f6f-4615-9a4b-b700d59aed1a could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:32:19.687338 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f282ffef-8aad-41a3-8c5d-81f2746011ab tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a" status: 404 len: 111 microversion: 2.1 time: 0.039509 Sep 15 19:32:19.687338 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 393/662] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:19 2022] GET /compute/v2.1/servers/b678c560-1f6f-4615-9a4b-b700d59aed1a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:32:19.704167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2fa2cd89-c930-404d-8013-5edfe1dbba10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:19.704167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2fa2cd89-c930-404d-8013-5edfe1dbba10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:19.723853 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fa2cd89-c930-404d-8013-5edfe1dbba10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:19.724348 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fa2cd89-c930-404d-8013-5edfe1dbba10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:19.724785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fa2cd89-c930-404d-8013-5edfe1dbba10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:19.725491 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fa2cd89-c930-404d-8013-5edfe1dbba10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:19.726039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fa2cd89-c930-404d-8013-5edfe1dbba10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:19.726543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fa2cd89-c930-404d-8013-5edfe1dbba10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:19.932822 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2fa2cd89-c930-404d-8013-5edfe1dbba10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:19.944115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2fa2cd89-c930-404d-8013-5edfe1dbba10 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1688 microversion: 2.1 time: 0.257396 Sep 15 19:32:19.944115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 394/663] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:19 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1688 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:20.123835 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-393dfb81-2d8d-40cd-a380-e9c65d89a9de req-6a1accf0-b77c-4048-868a-1d4b29624853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958ffdf6-6239-4d43-a0ba-0769a4b3cfa4", "name": "network-vif-deleted", "tag": "08bcba4d-cc67-49aa-a757-7898965bb03a"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:20.135935 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-393dfb81-2d8d-40cd-a380-e9c65d89a9de req-6a1accf0-b77c-4048-868a-1d4b29624853 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:20.136709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-393dfb81-2d8d-40cd-a380-e9c65d89a9de req-6a1accf0-b77c-4048-868a-1d4b29624853 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:20.137384 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-393dfb81-2d8d-40cd-a380-e9c65d89a9de req-6a1accf0-b77c-4048-868a-1d4b29624853 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:20.153890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-393dfb81-2d8d-40cd-a380-e9c65d89a9de req-6a1accf0-b77c-4048-868a-1d4b29624853 service nova] Creating event network-vif-deleted:08bcba4d-cc67-49aa-a757-7898965bb03a for instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 on hv-cinder-84984 Sep 15 19:32:20.161283 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-393dfb81-2d8d-40cd-a380-e9c65d89a9de req-6a1accf0-b77c-4048-868a-1d4b29624853 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041860 Sep 15 19:32:20.163229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 395/664] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:20.476818 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e9818a26-b998-42ec-8127-d69dbe1d4993 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:20.477396 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e9818a26-b998-42ec-8127-d69dbe1d4993 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:20.483555 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e9818a26-b998-42ec-8127-d69dbe1d4993 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:20.484035 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e9818a26-b998-42ec-8127-d69dbe1d4993 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:20.484537 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e9818a26-b998-42ec-8127-d69dbe1d4993 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:20.485230 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e9818a26-b998-42ec-8127-d69dbe1d4993 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:20.485680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e9818a26-b998-42ec-8127-d69dbe1d4993 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:20.486103 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e9818a26-b998-42ec-8127-d69dbe1d4993 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:20.554032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e9818a26-b998-42ec-8127-d69dbe1d4993 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:20.562849 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e9818a26-b998-42ec-8127-d69dbe1d4993 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1614 microversion: 2.1 time: 0.090430 Sep 15 19:32:20.563419 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 396/665] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:20 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:20.672593 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f60618ce-ba05-4a12-aef6-0571d8fbb5dd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:20.673358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f60618ce-ba05-4a12-aef6-0571d8fbb5dd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:20.679533 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f60618ce-ba05-4a12-aef6-0571d8fbb5dd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:20.680048 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f60618ce-ba05-4a12-aef6-0571d8fbb5dd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:20.680570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f60618ce-ba05-4a12-aef6-0571d8fbb5dd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:20.681290 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f60618ce-ba05-4a12-aef6-0571d8fbb5dd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:20.681735 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f60618ce-ba05-4a12-aef6-0571d8fbb5dd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:20.682156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f60618ce-ba05-4a12-aef6-0571d8fbb5dd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:20.822812 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f60618ce-ba05-4a12-aef6-0571d8fbb5dd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:20.831642 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f60618ce-ba05-4a12-aef6-0571d8fbb5dd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1674 microversion: 2.1 time: 0.170696 Sep 15 19:32:20.832262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 397/666] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:20 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:20.965971 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7fd5dae0-a103-42db-b9ab-d86ff83f401c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:20.966580 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7fd5dae0-a103-42db-b9ab-d86ff83f401c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:20.972643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7fd5dae0-a103-42db-b9ab-d86ff83f401c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:20.973123 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7fd5dae0-a103-42db-b9ab-d86ff83f401c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:20.973556 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7fd5dae0-a103-42db-b9ab-d86ff83f401c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:20.974238 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7fd5dae0-a103-42db-b9ab-d86ff83f401c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:20.974687 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7fd5dae0-a103-42db-b9ab-d86ff83f401c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:20.975106 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7fd5dae0-a103-42db-b9ab-d86ff83f401c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:21.138714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7fd5dae0-a103-42db-b9ab-d86ff83f401c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:21.142651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:21.147837 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7fd5dae0-a103-42db-b9ab-d86ff83f401c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1688 microversion: 2.1 time: 0.185595 Sep 15 19:32:21.156835 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 398/667] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:20 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:21.588083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-16dc8c6c-6df6-4fcb-a23f-ecc74b6ad7ad tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:21.588729 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-16dc8c6c-6df6-4fcb-a23f-ecc74b6ad7ad tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:21.595810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16dc8c6c-6df6-4fcb-a23f-ecc74b6ad7ad tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:21.596312 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16dc8c6c-6df6-4fcb-a23f-ecc74b6ad7ad tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:21.596717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16dc8c6c-6df6-4fcb-a23f-ecc74b6ad7ad tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:21.597403 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16dc8c6c-6df6-4fcb-a23f-ecc74b6ad7ad tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:21.597848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16dc8c6c-6df6-4fcb-a23f-ecc74b6ad7ad tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:21.598320 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16dc8c6c-6df6-4fcb-a23f-ecc74b6ad7ad tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:21.661171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-16dc8c6c-6df6-4fcb-a23f-ecc74b6ad7ad tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:21.668752 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-16dc8c6c-6df6-4fcb-a23f-ecc74b6ad7ad tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1614 microversion: 2.1 time: 0.084701 Sep 15 19:32:21.669320 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 399/668] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:21 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:21.857399 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-142636c1-57ce-49b5-a4b6-efcdc556bb2f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:21.857950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-142636c1-57ce-49b5-a4b6-efcdc556bb2f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:21.864376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-142636c1-57ce-49b5-a4b6-efcdc556bb2f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:21.864881 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-142636c1-57ce-49b5-a4b6-efcdc556bb2f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:21.865306 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-142636c1-57ce-49b5-a4b6-efcdc556bb2f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:21.865992 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-142636c1-57ce-49b5-a4b6-efcdc556bb2f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:21.866443 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-142636c1-57ce-49b5-a4b6-efcdc556bb2f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:21.866857 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-142636c1-57ce-49b5-a4b6-efcdc556bb2f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:22.010656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-142636c1-57ce-49b5-a4b6-efcdc556bb2f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:22.019089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-142636c1-57ce-49b5-a4b6-efcdc556bb2f tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1674 microversion: 2.1 time: 0.165777 Sep 15 19:32:22.019679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 400/669] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:21 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:22.170786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-02b88c0f-906d-4693-92db-e0e08d60c901 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:22.171403 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-02b88c0f-906d-4693-92db-e0e08d60c901 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:22.178885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-02b88c0f-906d-4693-92db-e0e08d60c901 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:22.179402 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-02b88c0f-906d-4693-92db-e0e08d60c901 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:22.179880 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-02b88c0f-906d-4693-92db-e0e08d60c901 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:22.180612 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-02b88c0f-906d-4693-92db-e0e08d60c901 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:22.181061 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-02b88c0f-906d-4693-92db-e0e08d60c901 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:22.181480 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-02b88c0f-906d-4693-92db-e0e08d60c901 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:22.313853 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-02b88c0f-906d-4693-92db-e0e08d60c901 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:22.321612 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-02b88c0f-906d-4693-92db-e0e08d60c901 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1688 microversion: 2.1 time: 0.155074 Sep 15 19:32:22.322178 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 401/670] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:22 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:22.696764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1e03de12-2204-4e40-89cc-5f2833de0ebf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:22.697606 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1e03de12-2204-4e40-89cc-5f2833de0ebf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:22.704216 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e03de12-2204-4e40-89cc-5f2833de0ebf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:22.704703 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e03de12-2204-4e40-89cc-5f2833de0ebf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:22.705142 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e03de12-2204-4e40-89cc-5f2833de0ebf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:22.705842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e03de12-2204-4e40-89cc-5f2833de0ebf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:22.706293 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e03de12-2204-4e40-89cc-5f2833de0ebf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:22.706715 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e03de12-2204-4e40-89cc-5f2833de0ebf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:22.770590 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1e03de12-2204-4e40-89cc-5f2833de0ebf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:22.778604 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1e03de12-2204-4e40-89cc-5f2833de0ebf tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1614 microversion: 2.1 time: 0.086002 Sep 15 19:32:22.779174 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 402/671] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:22 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:23.042936 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-33eea5fe-2248-4db0-b533-0068c26e5dbb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:23.043560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-33eea5fe-2248-4db0-b533-0068c26e5dbb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:23.050675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-33eea5fe-2248-4db0-b533-0068c26e5dbb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:23.051166 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-33eea5fe-2248-4db0-b533-0068c26e5dbb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:23.051603 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-33eea5fe-2248-4db0-b533-0068c26e5dbb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:23.052320 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-33eea5fe-2248-4db0-b533-0068c26e5dbb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:23.052779 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-33eea5fe-2248-4db0-b533-0068c26e5dbb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:23.053204 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-33eea5fe-2248-4db0-b533-0068c26e5dbb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:23.190821 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-33eea5fe-2248-4db0-b533-0068c26e5dbb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:23.199003 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-33eea5fe-2248-4db0-b533-0068c26e5dbb tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1674 microversion: 2.1 time: 0.159819 Sep 15 19:32:23.199517 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 403/672] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:23 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:23.345688 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ea6ff015-0816-459a-b83c-3447ea5dbbfd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:23.346394 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ea6ff015-0816-459a-b83c-3447ea5dbbfd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:23.352492 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea6ff015-0816-459a-b83c-3447ea5dbbfd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:23.353780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea6ff015-0816-459a-b83c-3447ea5dbbfd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:23.353780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea6ff015-0816-459a-b83c-3447ea5dbbfd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:23.354151 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea6ff015-0816-459a-b83c-3447ea5dbbfd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:23.354605 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea6ff015-0816-459a-b83c-3447ea5dbbfd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:23.355030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea6ff015-0816-459a-b83c-3447ea5dbbfd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:23.489613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ea6ff015-0816-459a-b83c-3447ea5dbbfd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:23.497536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ea6ff015-0816-459a-b83c-3447ea5dbbfd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1688 microversion: 2.1 time: 0.156382 Sep 15 19:32:23.498108 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 404/673] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:23 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:23.803615 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7a50bc02-7008-4807-ba0a-1c87314271ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:23.805301 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7a50bc02-7008-4807-ba0a-1c87314271ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:23.814404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7a50bc02-7008-4807-ba0a-1c87314271ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:23.814961 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7a50bc02-7008-4807-ba0a-1c87314271ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:23.815403 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7a50bc02-7008-4807-ba0a-1c87314271ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:23.816184 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7a50bc02-7008-4807-ba0a-1c87314271ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:23.816639 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7a50bc02-7008-4807-ba0a-1c87314271ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:23.817575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7a50bc02-7008-4807-ba0a-1c87314271ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:23.909488 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7a50bc02-7008-4807-ba0a-1c87314271ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:23.917936 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7a50bc02-7008-4807-ba0a-1c87314271ff tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 200 len: 1614 microversion: 2.1 time: 0.119314 Sep 15 19:32:23.918621 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 405/674] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:23 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 1614 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:23.924295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-db70e207-9f29-44f5-bbe3-ffcfa42b8d40 req-def10eac-8199-40fe-bbe8-6d3559eaf8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212105c1-8435-430c-9ffa-72e8a6bd2426", "name": "network-vif-unplugged", "status": "completed", "tag": "e07717f9-44fe-4be0-919e-d14afd6d6dcf"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:23.938258 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-db70e207-9f29-44f5-bbe3-ffcfa42b8d40 req-def10eac-8199-40fe-bbe8-6d3559eaf8cb service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:23.938258 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-db70e207-9f29-44f5-bbe3-ffcfa42b8d40 req-def10eac-8199-40fe-bbe8-6d3559eaf8cb service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:23.938996 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-db70e207-9f29-44f5-bbe3-ffcfa42b8d40 req-def10eac-8199-40fe-bbe8-6d3559eaf8cb service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:23.951985 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-db70e207-9f29-44f5-bbe3-ffcfa42b8d40 req-def10eac-8199-40fe-bbe8-6d3559eaf8cb service nova] Creating event network-vif-unplugged:e07717f9-44fe-4be0-919e-d14afd6d6dcf for instance 212105c1-8435-430c-9ffa-72e8a6bd2426 on hv-cinder-84984 Sep 15 19:32:23.957177 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-db70e207-9f29-44f5-bbe3-ffcfa42b8d40 req-def10eac-8199-40fe-bbe8-6d3559eaf8cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037291 Sep 15 19:32:23.958574 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 406/675] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:24.225020 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fe8f8a47-a2fe-441b-80c6-5187ff8b2001 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:24.225722 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fe8f8a47-a2fe-441b-80c6-5187ff8b2001 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:24.232804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe8f8a47-a2fe-441b-80c6-5187ff8b2001 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:24.233051 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe8f8a47-a2fe-441b-80c6-5187ff8b2001 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:24.234011 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe8f8a47-a2fe-441b-80c6-5187ff8b2001 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:24.234703 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe8f8a47-a2fe-441b-80c6-5187ff8b2001 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:24.235332 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe8f8a47-a2fe-441b-80c6-5187ff8b2001 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:24.235772 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe8f8a47-a2fe-441b-80c6-5187ff8b2001 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:24.558077 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fe8f8a47-a2fe-441b-80c6-5187ff8b2001 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:24.568402 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fe8f8a47-a2fe-441b-80c6-5187ff8b2001 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1674 microversion: 2.1 time: 0.347575 Sep 15 19:32:24.568983 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 407/676] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:24 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1674 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:24.574011 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e6632fd4-dd9e-447c-a04f-ffd177cf1b7b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:24.574619 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e6632fd4-dd9e-447c-a04f-ffd177cf1b7b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:24.580659 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6632fd4-dd9e-447c-a04f-ffd177cf1b7b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:24.581138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6632fd4-dd9e-447c-a04f-ffd177cf1b7b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:24.581741 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6632fd4-dd9e-447c-a04f-ffd177cf1b7b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:24.582439 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6632fd4-dd9e-447c-a04f-ffd177cf1b7b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:24.582896 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6632fd4-dd9e-447c-a04f-ffd177cf1b7b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:24.583308 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6632fd4-dd9e-447c-a04f-ffd177cf1b7b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:25.086753 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e6632fd4-dd9e-447c-a04f-ffd177cf1b7b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:25.094621 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e6632fd4-dd9e-447c-a04f-ffd177cf1b7b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1688 microversion: 2.1 time: 0.524457 Sep 15 19:32:25.095197 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 408/677] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:24 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1688 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:25.126933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b6cf24eb-3636-4c3b-bae0-5bf4a5af6546 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:25.127716 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b6cf24eb-3636-4c3b-bae0-5bf4a5af6546 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:25.133808 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6cf24eb-3636-4c3b-bae0-5bf4a5af6546 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:25.134295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6cf24eb-3636-4c3b-bae0-5bf4a5af6546 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:25.134749 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6cf24eb-3636-4c3b-bae0-5bf4a5af6546 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:25.135443 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6cf24eb-3636-4c3b-bae0-5bf4a5af6546 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:25.135945 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6cf24eb-3636-4c3b-bae0-5bf4a5af6546 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:25.136366 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b6cf24eb-3636-4c3b-bae0-5bf4a5af6546 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-b6cf24eb-3636-4c3b-bae0-5bf4a5af6546 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b6cf24eb-3636-4c3b-bae0-5bf4a5af6546 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 HTTP/1.1 Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:32:25.154700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:32:25.160841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:32:25.160841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:32:25.160841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:32:25.160841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:32:25.160841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:32:25.160841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:32:25.160841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:32:25.160841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:32:25.160841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:32:25.160841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:32:25.160841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:32:25.160841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '958ffdf6-6239-4d43-a0ba-0769a4b3cfa4'} Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:32:25.161717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:32:25.163167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:25.165093 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b6cf24eb-3636-4c3b-bae0-5bf4a5af6546 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 404 to user: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:32:25.165093 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b6cf24eb-3636-4c3b-bae0-5bf4a5af6546 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 404 len: 111 microversion: 2.1 time: 0.042704 Sep 15 19:32:25.165093 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 409/678] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:25 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:32:25.165093 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b1ec5f76-6040-4494-8b66-d5dbdecc479e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '.version_select at 0x7f551ea3ba60>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:25.288030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b1ec5f76-6040-4494-8b66-d5dbdecc479e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1919551565" status: 202 len: 0 microversion: 2.1 time: 0.127745 Sep 15 19:32:25.288856 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 410/679] 10.222.0.18 () {58 vars in 1221 bytes} [Thu Sep 15 19:32:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1919551565 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 19:32:25.595006 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9a7354d6-648e-4f4f-b61c-d703d9d2c80b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:25.595627 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9a7354d6-648e-4f4f-b61c-d703d9d2c80b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:25.622577 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a7354d6-648e-4f4f-b61c-d703d9d2c80b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:25.622933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a7354d6-648e-4f4f-b61c-d703d9d2c80b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:25.623370 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a7354d6-648e-4f4f-b61c-d703d9d2c80b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:25.624146 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a7354d6-648e-4f4f-b61c-d703d9d2c80b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:25.624598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a7354d6-648e-4f4f-b61c-d703d9d2c80b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:25.625025 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a7354d6-648e-4f4f-b61c-d703d9d2c80b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:25.771704 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9a7354d6-648e-4f4f-b61c-d703d9d2c80b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:25.781105 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9a7354d6-648e-4f4f-b61c-d703d9d2c80b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1606 microversion: 2.1 time: 0.190760 Sep 15 19:32:25.782026 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 411/680] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:25 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1606 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:25.788239 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-e2e58a0a-6598-4a60-bc91-f0cc7fdc8e3e req-e3e963af-963e-4771-86d4-b67e4711db91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212105c1-8435-430c-9ffa-72e8a6bd2426", "name": "network-vif-deleted", "tag": "e07717f9-44fe-4be0-919e-d14afd6d6dcf"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:25.800936 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e2e58a0a-6598-4a60-bc91-f0cc7fdc8e3e req-e3e963af-963e-4771-86d4-b67e4711db91 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:25.801415 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e2e58a0a-6598-4a60-bc91-f0cc7fdc8e3e req-e3e963af-963e-4771-86d4-b67e4711db91 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:25.801840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e2e58a0a-6598-4a60-bc91-f0cc7fdc8e3e req-e3e963af-963e-4771-86d4-b67e4711db91 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:25.818313 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-e2e58a0a-6598-4a60-bc91-f0cc7fdc8e3e req-e3e963af-963e-4771-86d4-b67e4711db91 service nova] Creating event network-vif-deleted:e07717f9-44fe-4be0-919e-d14afd6d6dcf for instance 212105c1-8435-430c-9ffa-72e8a6bd2426 on hv-cinder-84984 Sep 15 19:32:25.842217 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-e2e58a0a-6598-4a60-bc91-f0cc7fdc8e3e req-e3e963af-963e-4771-86d4-b67e4711db91 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058645 Sep 15 19:32:25.846718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 412/681] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:26.120575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:26.125359 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:26.132545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:26.134360 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:26.135147 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:26.143236 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:26.145043 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:26.145701 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:26.183793 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:26.185304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:26.196248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:26.198099 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lazy-loading 'fault' on Instance uuid 212105c1-8435-430c-9ffa-72e8a6bd2426 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:32:26.293934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:26.307264 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7ceec401-660a-4fc9-9a91-102bfdc62f06 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 200 len: 1334 microversion: 2.1 time: 0.191929 Sep 15 19:32:26.312694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 413/682] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:26 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 1334 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:26.500869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cf9c878c-bc4b-49a1-b244-c441f5d074de tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Action: 'create', calling method: .version_select at 0x7f551ea13ee0>, body: {"keypair": {"name": "tempest-keypair-1123975815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqDsj/O0a6ITO24HOisfoue6krVb0wSBezgz9Hvl4Fk2zJWapou4AGDFufjncQFgfCTCqdcQ5RAHgA5+gKj3TN8gUjdD/vvmUF150h1W3T1+p9I/Fo0CDt3jBEvQLlurA=="}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:26.518538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-cf9c878c-bc4b-49a1-b244-c441f5d074de tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:32:26.524668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-cf9c878c-bc4b-49a1-b244-c441f5d074de tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for user 0e37c8ca70ad4b6e8430a71d0f5e564f and project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:32:26.695503 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cf9c878c-bc4b-49a1-b244-c441f5d074de tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.200335 Sep 15 19:32:26.696649 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 414/683] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 15 19:32:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:32:26.809037 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:26.810230 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:26.822410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:26.822909 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:26.823347 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:26.824489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:26.825013 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:26.825564 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:26.882610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:26.883383 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:26.883998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:26.885299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lazy-loading 'fault' on Instance uuid 8ddcd684-503e-4123-9078-c4821c63519f {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:32:26.967113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:26.978368 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2fddcd8e-52b3-4ca6-98ba-51e54881e128 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1327 microversion: 2.1 time: 0.174045 Sep 15 19:32:26.978956 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 415/684] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:26 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1327 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:27.337770 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-818c04a0-ee32-4e51-ab76-936955258b6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:27.338516 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-818c04a0-ee32-4e51-ab76-936955258b6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 212105c1-8435-430c-9ffa-72e8a6bd2426] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:27.345327 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-818c04a0-ee32-4e51-ab76-936955258b6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:27.345827 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-818c04a0-ee32-4e51-ab76-936955258b6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:27.346349 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-818c04a0-ee32-4e51-ab76-936955258b6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:27.347060 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-818c04a0-ee32-4e51-ab76-936955258b6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:27.347517 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-818c04a0-ee32-4e51-ab76-936955258b6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:27.347972 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-818c04a0-ee32-4e51-ab76-936955258b6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:27.361749 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-818c04a0-ee32-4e51-ab76-936955258b6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] HTTP exception thrown: Instance 212105c1-8435-430c-9ffa-72e8a6bd2426 could not be found. Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-818c04a0-ee32-4e51-ab76-936955258b6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Request method failure captured: Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 HTTP/1.1 Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2gP0Gamuz7MW6kt5fLWKd3NLL-PP3YSW0U9aHiJ2uXiR5ltQi77FsMQyXTqL_ThLEIKacMbb8OOMEUFv5IMw0TOPVnWuEE3VOpC98z4LA6wvz2NMPIxQroKGaTQtiVlHx-Xt0EbiHTVWLkl0p0ZJGv_y0Kwm5RmsVyVsM-g7xfCk Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 016f968319fd49d98506030c0bee6021 Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:32:27.363389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:32:27.365328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_016f968319fd49d98506030c0bee6021", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/016f968319fd49d98506030c0bee6021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/016f968319fd49d98506030c0bee6021"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/016f968319fd49d98506030c0bee6021"}]}] Sep 15 19:32:27.365328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:32:27.365328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 016f968319fd49d98506030c0bee6021 Sep 15 19:32:27.365328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:32:27.365328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-ServerRescueNegativeTestJSON-1036181242-project Sep 15 19:32:27.365328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:32:27.365328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:32:27.365328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 1d7c40b5232e46119434aeeb8a6ad4d0 Sep 15 19:32:27.365328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1036181242-project Sep 15 19:32:27.365328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:32:27.365328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 212105c1-8435-430c-9ffa-72e8a6bd2426 could not be found. Sep 15 19:32:27.365328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '212105c1-8435-430c-9ffa-72e8a6bd2426'} Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 212105c1-8435-430c-9ffa-72e8a6bd2426 could not be found. Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:32:27.366804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 212105c1-8435-430c-9ffa-72e8a6bd2426 could not be found. Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 212105c1-8435-430c-9ffa-72e8a6bd2426 could not be found. Sep 15 19:32:27.369714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:27.375567 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-818c04a0-ee32-4e51-ab76-936955258b6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Returning 404 to user: Instance 212105c1-8435-430c-9ffa-72e8a6bd2426 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:32:27.375567 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-818c04a0-ee32-4e51-ab76-936955258b6d tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426" status: 404 len: 111 microversion: 2.1 time: 0.031148 Sep 15 19:32:27.375567 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 416/685] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:27 2022] GET /compute/v2.1/servers/212105c1-8435-430c-9ffa-72e8a6bd2426 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:32:27.375567 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c9be28b0-3240-47ac-b927-6e86ef25630b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '.version_select at 0x7f551eb09040>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:27.523476 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c9be28b0-3240-47ac-b927-6e86ef25630b tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-439571901" status: 202 len: 0 microversion: 2.1 time: 0.153268 Sep 15 19:32:27.524118 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 417/686] 10.222.0.18 () {58 vars in 1218 bytes} [Thu Sep 15 19:32:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-439571901 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:32:27.862937 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-5271c4ca-9055-46f6-b66a-30a7516aab98 req-32403de5-eb6a-49a5-b8b1-ba1adbcd5ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddcd684-503e-4123-9078-c4821c63519f", "name": "network-vif-deleted", "tag": "83b9862f-0442-4819-8455-b738ec1a0232"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:27.876406 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-5271c4ca-9055-46f6-b66a-30a7516aab98 req-32403de5-eb6a-49a5-b8b1-ba1adbcd5ee2 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:27.876879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-5271c4ca-9055-46f6-b66a-30a7516aab98 req-32403de5-eb6a-49a5-b8b1-ba1adbcd5ee2 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:27.880859 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-5271c4ca-9055-46f6-b66a-30a7516aab98 req-32403de5-eb6a-49a5-b8b1-ba1adbcd5ee2 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:27.892997 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-5271c4ca-9055-46f6-b66a-30a7516aab98 req-32403de5-eb6a-49a5-b8b1-ba1adbcd5ee2 service nova] Creating event network-vif-deleted:83b9862f-0442-4819-8455-b738ec1a0232 for instance 8ddcd684-503e-4123-9078-c4821c63519f on hv-cinder-84984 Sep 15 19:32:27.898097 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-5271c4ca-9055-46f6-b66a-30a7516aab98 req-32403de5-eb6a-49a5-b8b1-ba1adbcd5ee2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039479 Sep 15 19:32:27.901535 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 418/687] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:32:28.003324 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:28.004163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:28.010591 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:28.011192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:28.011545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:28.012268 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:28.012717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:28.013135 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:28.044946 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:28.045429 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:28.046435 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:28.046878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lazy-loading 'fault' on Instance uuid 8ddcd684-503e-4123-9078-c4821c63519f {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:32:28.089346 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:28.097841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ac0cd98c-3d26-4d72-a6c2-4ebe321fe2da tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1327 microversion: 2.1 time: 0.099427 Sep 15 19:32:28.111680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 419/688] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:27 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:29.122049 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:29.122699 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:29.129467 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:29.129873 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:29.130304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:29.130999 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:29.131445 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:29.131895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:29.163701 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:29.164191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:29.164622 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:29.165075 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lazy-loading 'fault' on Instance uuid 8ddcd684-503e-4123-9078-c4821c63519f {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:32:29.168268 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:29.209826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:29.217882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bf010195-7f9f-4250-96db-5cd38cff111a tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 200 len: 1327 microversion: 2.1 time: 0.099576 Sep 15 19:32:29.218472 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 420/689] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:29 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:29.836005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-246036261", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f608162d-6498-4eba-ac51-7e7b4de51e0d"}], "security_groups": [{"name": "tempest-securitygroup--726102103"}], "key_name": "tempest-keypair-1123975815", "user_data": "}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:29.940741 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] validate_networks() for [('f608162d-6498-4eba-ac51-7e7b4de51e0d', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:32:30.133597 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:30.435453 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:32:30.435891 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:32:30.438311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:32:30.438311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:32:30.438311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:32:30.446371 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:30.446845 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:30.447271 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:30.448020 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:30.448464 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:30.448884 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:30.466311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:32:30.470411 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Getting quotas for user 0e37c8ca70ad4b6e8430a71d0f5e564f and project 53ec78c2e65c4f0c86d505c409031ab6. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:32:30.481677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:32:30.484022 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:32:30.604587 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-27e6325d-aef7-40a3-aa46-4132c853b28a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.772892 Sep 15 19:32:30.611201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 421/690] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:32:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 19:32:30.611201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-805fa741-4940-40ab-babf-11b437905967 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:30.611201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-805fa741-4940-40ab-babf-11b437905967 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:30.617048 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-805fa741-4940-40ab-babf-11b437905967 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:30.619018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-805fa741-4940-40ab-babf-11b437905967 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:30.619018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-805fa741-4940-40ab-babf-11b437905967 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:30.619018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-805fa741-4940-40ab-babf-11b437905967 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:30.619326 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-805fa741-4940-40ab-babf-11b437905967 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:30.619791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-805fa741-4940-40ab-babf-11b437905967 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:30.636147 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-805fa741-4940-40ab-babf-11b437905967 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] HTTP exception thrown: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-805fa741-4940-40ab-babf-11b437905967 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Request method failure captured: Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f HTTP/1.1 Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3zT6kDQ9Io6lHalRBgBJgcCiy22cNKVdKEP6Zrlj2oDNnS4DBn31E-3_IbiOcPAyZC3zWOQmlN-ZoWdEH9iu2VkV7zKiqSVx3kyVF6It3h4iqEzhkv_K36XLiifpCA_Gnsj306FZJ62uRpoZrBG6CzFxzOdfIkq4X2R6tot1oqH9Ew Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 340975b28fc242b5bf4a3364fe702ad4 Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:32:30.637882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:32:30.640278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_340975b28fc242b5bf4a3364fe702ad4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/340975b28fc242b5bf4a3364fe702ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/340975b28fc242b5bf4a3364fe702ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/340975b28fc242b5bf4a3364fe702ad4"}]}] Sep 15 19:32:30.640278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:32:30.640278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 340975b28fc242b5bf4a3364fe702ad4 Sep 15 19:32:30.640278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:32:30.640278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeTestJSON-820242980-project Sep 15 19:32:30.640278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:32:30.640278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:32:30.640278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: cfbdd49e2fa64b428d957d9dcf1d6846 Sep 15 19:32:30.640278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeTestJSON-820242980-project Sep 15 19:32:30.640278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:32:30.640278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:32:30.640278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '8ddcd684-503e-4123-9078-c4821c63519f'} Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:32:30.641209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:32:30.642696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:30.643995 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-805fa741-4940-40ab-babf-11b437905967 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Returning 404 to user: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:32:30.643995 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-805fa741-4940-40ab-babf-11b437905967 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 404 len: 111 microversion: 2.1 time: 0.033061 Sep 15 19:32:30.643995 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 422/691] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:30 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:32:30.645252 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1547847d-e9a2-438c-b0fa-25efb26c5902 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:30.645889 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1547847d-e9a2-438c-b0fa-25efb26c5902 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:30.722832 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1547847d-e9a2-438c-b0fa-25efb26c5902 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:30.731192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1547847d-e9a2-438c-b0fa-25efb26c5902 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1241 microversion: 2.1 time: 0.089391 Sep 15 19:32:30.736059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 423/692] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:30 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:30.744531 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6c9e2362-1b97-4f25-b61b-6c2f385ae718 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '.version_select at 0x7f551e9c19d0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:30.860102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6c9e2362-1b97-4f25-b61b-6c2f385ae718 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-154239194" status: 202 len: 0 microversion: 2.1 time: 0.122472 Sep 15 19:32:30.864356 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 424/693] 10.222.0.18 () {58 vars in 1218 bytes} [Thu Sep 15 19:32:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-154239194 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:32:30.871534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-437154569", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "networks": [{"uuid": "b7b1b4db-7cb7-47a8-9ce9-f4ee2a46f058"}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:30.931965 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] validate_networks() for [('b7b1b4db-7cb7-47a8-9ce9-f4ee2a46f058', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:32:31.496264 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:32:31.497352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:32:31.497830 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:32:31.498600 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:32:31.500086 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:32:31.510802 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:31.511549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:31.512084 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:31.512848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:31.513255 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:31.513677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:31.531800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Getting quotas for project ee88123fe2e34b02a00baeb6f74869aa. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:32:31.535579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Getting quotas for user 8c76463423664f649bd018d853010cad and project ee88123fe2e34b02a00baeb6f74869aa. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:32:31.547258 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:32:31.549648 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:32:31.788386 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e6b940ed-1fcc-4fa9-855f-9d867e94769a tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926600 Sep 15 19:32:31.789402 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 425/694] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:32:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 19:32:31.794505 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c5449987-883d-45bc-94b4-a6a3b32d82ef tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:31.795588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c5449987-883d-45bc-94b4-a6a3b32d82ef tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:31.880513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c5449987-883d-45bc-94b4-a6a3b32d82ef tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:31.888380 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c5449987-883d-45bc-94b4-a6a3b32d82ef tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1241 microversion: 2.1 time: 0.097718 Sep 15 19:32:31.888952 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 426/695] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:31 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:31.902299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-681583469", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-263373816", "security_groups": [{"name": "tempest-secgroup-smoke-1102370236"}], "networks": [{"uuid": "3764c9bd-aafe-448d-9672-4244678df38d"}], "block_device_mapping_v2": [{"uuid": "51235e0b-21e1-465c-8122-7f05f354f923", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:32.053266 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] validate_networks() for [('3764c9bd-aafe-448d-9672-4244678df38d', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:32:32.477783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:32:32.478224 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:32:32.478677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:32:32.478968 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:32:32.479369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:32:32.488209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:32.488682 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:32.489105 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:32.489815 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:32.490261 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:32.490672 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:32.507715 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Getting quotas for project a7bbec449c0142f0b910956bacedbe5e. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:32:32.511619 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Getting quotas for user b638c6d935e64be6bce4ecc1fb8f26ec and project a7bbec449c0142f0b910956bacedbe5e. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:32:32.567893 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:32:32.569943 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='51235e0b-21e1-465c-8122-7f05f354f923',volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:32:33.124456 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e39e7cfd-54be-4542-a60c-5c701a2c63f9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.233419 Sep 15 19:32:33.125061 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 427/696] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:32:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 19:32:33.129529 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9fdf0589-a039-4549-bf89-a15ec0732317 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:33.130138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9fdf0589-a039-4549-bf89-a15ec0732317 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:33.137124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9fdf0589-a039-4549-bf89-a15ec0732317 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:33.137955 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9fdf0589-a039-4549-bf89-a15ec0732317 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:33.138078 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9fdf0589-a039-4549-bf89-a15ec0732317 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:33.138802 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9fdf0589-a039-4549-bf89-a15ec0732317 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:33.139149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9fdf0589-a039-4549-bf89-a15ec0732317 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:33.139561 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9fdf0589-a039-4549-bf89-a15ec0732317 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:33.203806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9fdf0589-a039-4549-bf89-a15ec0732317 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:33.214966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9fdf0589-a039-4549-bf89-a15ec0732317 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1222 microversion: 2.1 time: 0.088842 Sep 15 19:32:33.219326 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 428/697] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:33 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:33.227437 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-342a4dbd-9cf1-4b0a-a870-4b3216ea391b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Action: 'create', calling method: .version_select at 0x7f551ea3b700>, body: {"keypair": {"name": "tempest-keypair-2005321195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSMyP+ptwjRWX2xs5uMf/yPJct2jh75u2HtVBr7pRMKD/UL08F/ad7CC+XBEDjCCYYIZNMrcrQnVIHRQfKXm7lr+h4ZGo5OWsKfFkzhE7+UAk8fF6qbJlaNOSmBEPPnyw=="}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:33.245787 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-342a4dbd-9cf1-4b0a-a870-4b3216ea391b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Getting quotas for project 340975b28fc242b5bf4a3364fe702ad4. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:32:33.250527 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-342a4dbd-9cf1-4b0a-a870-4b3216ea391b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Getting quotas for user cfbdd49e2fa64b428d957d9dcf1d6846 and project 340975b28fc242b5bf4a3364fe702ad4. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:32:33.360149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-342a4dbd-9cf1-4b0a-a870-4b3216ea391b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137553 Sep 15 19:32:33.360807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 429/698] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 15 19:32:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:33.365767 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-893049ca-a2c2-47ce-b3f1-686ed71abebd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:33.369448 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-893049ca-a2c2-47ce-b3f1-686ed71abebd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:33.373905 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-893049ca-a2c2-47ce-b3f1-686ed71abebd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:33.374399 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-893049ca-a2c2-47ce-b3f1-686ed71abebd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:33.374836 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-893049ca-a2c2-47ce-b3f1-686ed71abebd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:33.375544 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-893049ca-a2c2-47ce-b3f1-686ed71abebd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:33.376029 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-893049ca-a2c2-47ce-b3f1-686ed71abebd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:33.376453 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-893049ca-a2c2-47ce-b3f1-686ed71abebd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:33.408573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-893049ca-a2c2-47ce-b3f1-686ed71abebd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:32:33.968898 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-893049ca-a2c2-47ce-b3f1-686ed71abebd tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 204 len: 0 microversion: 2.1 time: 0.606625 Sep 15 19:32:33.973310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 430/699] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:32:33 2022] DELETE /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 19:32:33.977907 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a4eb367d-7fcc-4a9e-bada-9e406121e664 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:33.978771 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a4eb367d-7fcc-4a9e-bada-9e406121e664 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:33.985840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a4eb367d-7fcc-4a9e-bada-9e406121e664 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:33.986486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a4eb367d-7fcc-4a9e-bada-9e406121e664 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:33.986987 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a4eb367d-7fcc-4a9e-bada-9e406121e664 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:33.987783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a4eb367d-7fcc-4a9e-bada-9e406121e664 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:33.988452 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a4eb367d-7fcc-4a9e-bada-9e406121e664 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:33.989132 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a4eb367d-7fcc-4a9e-bada-9e406121e664 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:34.078335 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a4eb367d-7fcc-4a9e-bada-9e406121e664 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:34.086122 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a4eb367d-7fcc-4a9e-bada-9e406121e664 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1299 microversion: 2.1 time: 0.114907 Sep 15 19:32:34.086628 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 431/700] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:33 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:34.091210 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ae5f789a-b9c9-4723-aed5-aa71ee266aab tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:34.091863 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ae5f789a-b9c9-4723-aed5-aa71ee266aab tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:34.162957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ae5f789a-b9c9-4723-aed5-aa71ee266aab tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:34.170029 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ae5f789a-b9c9-4723-aed5-aa71ee266aab tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1087 microversion: 2.1 time: 0.082380 Sep 15 19:32:34.181864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 432/701] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:34 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1087 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:34.181864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-231eb423-17d7-4881-b8ec-957331cacfb3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:34.181864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-231eb423-17d7-4881-b8ec-957331cacfb3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:34.182679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-231eb423-17d7-4881-b8ec-957331cacfb3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:34.183171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-231eb423-17d7-4881-b8ec-957331cacfb3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:34.183609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-231eb423-17d7-4881-b8ec-957331cacfb3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:34.184341 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-231eb423-17d7-4881-b8ec-957331cacfb3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:34.184788 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-231eb423-17d7-4881-b8ec-957331cacfb3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:34.185470 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-231eb423-17d7-4881-b8ec-957331cacfb3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:34.315089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-231eb423-17d7-4881-b8ec-957331cacfb3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:34.327484 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-231eb423-17d7-4881-b8ec-957331cacfb3 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1509 microversion: 2.1 time: 0.151265 Sep 15 19:32:34.327484 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 433/702] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:34 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:34.329900 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6408c9c4-c580-4cc7-be84-256295460c7b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:34.330693 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6408c9c4-c580-4cc7-be84-256295460c7b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:34.338623 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6408c9c4-c580-4cc7-be84-256295460c7b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:34.339263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6408c9c4-c580-4cc7-be84-256295460c7b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:34.339894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6408c9c4-c580-4cc7-be84-256295460c7b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:34.340750 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6408c9c4-c580-4cc7-be84-256295460c7b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:34.341211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6408c9c4-c580-4cc7-be84-256295460c7b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:34.341636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6408c9c4-c580-4cc7-be84-256295460c7b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:34.463726 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6408c9c4-c580-4cc7-be84-256295460c7b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:34.473937 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6408c9c4-c580-4cc7-be84-256295460c7b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1270 microversion: 2.1 time: 0.148208 Sep 15 19:32:34.475038 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 434/703] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:34 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:35.111503 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4de6227f-23af-451f-aa0a-cc309f8aed2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:35.112257 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4de6227f-23af-451f-aa0a-cc309f8aed2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:35.118809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4de6227f-23af-451f-aa0a-cc309f8aed2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:35.119287 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4de6227f-23af-451f-aa0a-cc309f8aed2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:35.119744 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4de6227f-23af-451f-aa0a-cc309f8aed2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:35.120452 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4de6227f-23af-451f-aa0a-cc309f8aed2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:35.120898 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4de6227f-23af-451f-aa0a-cc309f8aed2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:35.121314 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4de6227f-23af-451f-aa0a-cc309f8aed2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:35.322339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4de6227f-23af-451f-aa0a-cc309f8aed2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:35.334560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4de6227f-23af-451f-aa0a-cc309f8aed2f tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1366 microversion: 2.1 time: 0.227705 Sep 15 19:32:35.335162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 435/704] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:35 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:35.340768 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-12e73195-dbcb-4846-a694-367ab7fe09f4 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:35.341581 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-12e73195-dbcb-4846-a694-367ab7fe09f4 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:35.349013 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12e73195-dbcb-4846-a694-367ab7fe09f4 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:35.350179 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12e73195-dbcb-4846-a694-367ab7fe09f4 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:35.350796 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12e73195-dbcb-4846-a694-367ab7fe09f4 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:35.351886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12e73195-dbcb-4846-a694-367ab7fe09f4 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:35.352504 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12e73195-dbcb-4846-a694-367ab7fe09f4 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:35.354160 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12e73195-dbcb-4846-a694-367ab7fe09f4 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:35.466695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-12e73195-dbcb-4846-a694-367ab7fe09f4 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:35.475323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-12e73195-dbcb-4846-a694-367ab7fe09f4 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1137 microversion: 2.1 time: 0.138692 Sep 15 19:32:35.476206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 436/705] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:35 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1137 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:35.497452 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3e71467a-19e5-4541-822f-cf1d1c27ce9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:35.498076 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3e71467a-19e5-4541-822f-cf1d1c27ce9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:35.501170 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:35.504912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e71467a-19e5-4541-822f-cf1d1c27ce9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:35.505403 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e71467a-19e5-4541-822f-cf1d1c27ce9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:35.505853 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e71467a-19e5-4541-822f-cf1d1c27ce9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:35.509718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e71467a-19e5-4541-822f-cf1d1c27ce9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:35.509718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e71467a-19e5-4541-822f-cf1d1c27ce9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:35.509718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e71467a-19e5-4541-822f-cf1d1c27ce9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:35.737776 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3e71467a-19e5-4541-822f-cf1d1c27ce9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:35.745386 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3e71467a-19e5-4541-822f-cf1d1c27ce9c tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1509 microversion: 2.1 time: 0.252628 Sep 15 19:32:35.746388 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 437/706] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:35 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1509 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:35.754358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-513d4e3f-b10c-499c-82c3-63e9c939a261 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:35.757531 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-513d4e3f-b10c-499c-82c3-63e9c939a261 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:35.767085 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-513d4e3f-b10c-499c-82c3-63e9c939a261 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:35.767580 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-513d4e3f-b10c-499c-82c3-63e9c939a261 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:35.768044 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-513d4e3f-b10c-499c-82c3-63e9c939a261 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:35.768928 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-513d4e3f-b10c-499c-82c3-63e9c939a261 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:35.774994 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-513d4e3f-b10c-499c-82c3-63e9c939a261 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:35.774994 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-513d4e3f-b10c-499c-82c3-63e9c939a261 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:35.847956 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-513d4e3f-b10c-499c-82c3-63e9c939a261 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:35.857421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-513d4e3f-b10c-499c-82c3-63e9c939a261 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1270 microversion: 2.1 time: 0.109443 Sep 15 19:32:35.858010 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 438/707] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:35 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:36.361552 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7ccf22d2-6ce9-40a0-8aa6-a29b75fee5f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:36.362277 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7ccf22d2-6ce9-40a0-8aa6-a29b75fee5f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:36.369977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ccf22d2-6ce9-40a0-8aa6-a29b75fee5f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:36.370686 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ccf22d2-6ce9-40a0-8aa6-a29b75fee5f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:36.371215 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ccf22d2-6ce9-40a0-8aa6-a29b75fee5f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:36.372318 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ccf22d2-6ce9-40a0-8aa6-a29b75fee5f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:36.373183 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ccf22d2-6ce9-40a0-8aa6-a29b75fee5f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:36.373936 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ccf22d2-6ce9-40a0-8aa6-a29b75fee5f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:36.653495 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7ccf22d2-6ce9-40a0-8aa6-a29b75fee5f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:36.662436 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7ccf22d2-6ce9-40a0-8aa6-a29b75fee5f0 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1366 microversion: 2.1 time: 0.304910 Sep 15 19:32:36.671450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 439/708] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:36 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:36.671450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c9e8c9c6-98fa-4ae7-8e20-f78ed2ed2fc9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:36.671450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c9e8c9c6-98fa-4ae7-8e20-f78ed2ed2fc9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:36.674946 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c9e8c9c6-98fa-4ae7-8e20-f78ed2ed2fc9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:36.675431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c9e8c9c6-98fa-4ae7-8e20-f78ed2ed2fc9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:36.676201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c9e8c9c6-98fa-4ae7-8e20-f78ed2ed2fc9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:36.677530 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c9e8c9c6-98fa-4ae7-8e20-f78ed2ed2fc9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:36.678499 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c9e8c9c6-98fa-4ae7-8e20-f78ed2ed2fc9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:36.679205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c9e8c9c6-98fa-4ae7-8e20-f78ed2ed2fc9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:36.784297 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c9e8c9c6-98fa-4ae7-8e20-f78ed2ed2fc9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:36.798869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c9e8c9c6-98fa-4ae7-8e20-f78ed2ed2fc9 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1185 microversion: 2.1 time: 0.134693 Sep 15 19:32:36.812486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 440/709] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:36 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:36.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-926da23f-255e-4f02-b1b1-62e52b8b6219 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:36.824789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-926da23f-255e-4f02-b1b1-62e52b8b6219 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:36.831746 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-926da23f-255e-4f02-b1b1-62e52b8b6219 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:36.832530 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-926da23f-255e-4f02-b1b1-62e52b8b6219 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:36.833424 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-926da23f-255e-4f02-b1b1-62e52b8b6219 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:36.834348 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-926da23f-255e-4f02-b1b1-62e52b8b6219 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:36.839351 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-926da23f-255e-4f02-b1b1-62e52b8b6219 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:36.839351 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-926da23f-255e-4f02-b1b1-62e52b8b6219 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:37.175202 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-926da23f-255e-4f02-b1b1-62e52b8b6219 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:37.192545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-926da23f-255e-4f02-b1b1-62e52b8b6219 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 200 len: 1509 microversion: 2.1 time: 0.378288 Sep 15 19:32:37.193328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 441/710] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:36 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 1509 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:37.232434 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1532774650", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6260c8ac-0673-45b5-914a-caba360d68d4"}], "security_groups": [{"name": "tempest-securitygroup--967576254"}], "key_name": "tempest-keypair-2005321195", "user_data": "}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:37.505223 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] validate_networks() for [('6260c8ac-0673-45b5-914a-caba360d68d4', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:32:38.381725 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:32:38.382544 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:32:38.383423 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:32:38.385176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:32:38.385176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:32:38.404721 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:38.407271 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:38.407271 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:38.407880 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:38.408721 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:38.409509 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:38.459317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Getting quotas for project 340975b28fc242b5bf4a3364fe702ad4. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:32:38.467334 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Getting quotas for user cfbdd49e2fa64b428d957d9dcf1d6846 and project 340975b28fc242b5bf4a3364fe702ad4. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:32:38.492501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:32:38.497193 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:32:38.691346 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d7ef383c-ce7c-439e-a5c4-0f74e37ef646 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.466064 Sep 15 19:32:38.693539 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 442/711] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 15 19:32:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 19:32:38.702758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2392a45e-aed1-4efc-8d44-feb3bc5a2914 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:38.704165 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2392a45e-aed1-4efc-8d44-feb3bc5a2914 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:38.715523 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2392a45e-aed1-4efc-8d44-feb3bc5a2914 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:38.720773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2392a45e-aed1-4efc-8d44-feb3bc5a2914 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:38.720773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2392a45e-aed1-4efc-8d44-feb3bc5a2914 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:38.720773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2392a45e-aed1-4efc-8d44-feb3bc5a2914 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:38.720773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2392a45e-aed1-4efc-8d44-feb3bc5a2914 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:38.721413 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2392a45e-aed1-4efc-8d44-feb3bc5a2914 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:39.002673 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2392a45e-aed1-4efc-8d44-feb3bc5a2914 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:39.007161 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:39.012258 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2392a45e-aed1-4efc-8d44-feb3bc5a2914 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1318 microversion: 2.1 time: 0.316935 Sep 15 19:32:39.012862 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 443/712] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:38 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:39.018326 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-11265381-f424-47ed-a4f2-2c5bc475bb93 req-1828a4c1-3fe1-4f61-9b54-21e78ee30c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c1a3e2-eab3-4cc3-b737-d88f242ecb62", "tag": "7433f2f7-bf4d-4108-9055-048e5b317dbb"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:39.033047 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-11265381-f424-47ed-a4f2-2c5bc475bb93 req-1828a4c1-3fe1-4f61-9b54-21e78ee30c68 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:39.033547 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-11265381-f424-47ed-a4f2-2c5bc475bb93 req-1828a4c1-3fe1-4f61-9b54-21e78ee30c68 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:39.052631 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-11265381-f424-47ed-a4f2-2c5bc475bb93 req-1828a4c1-3fe1-4f61-9b54-21e78ee30c68 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:39.052631 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-11265381-f424-47ed-a4f2-2c5bc475bb93 req-1828a4c1-3fe1-4f61-9b54-21e78ee30c68 service nova] Creating event network-changed:7433f2f7-bf4d-4108-9055-048e5b317dbb for instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 on hv-cinder-84984 Sep 15 19:32:39.053172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-11265381-f424-47ed-a4f2-2c5bc475bb93 req-1828a4c1-3fe1-4f61-9b54-21e78ee30c68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038640 Sep 15 19:32:39.054180 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 444/713] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:39.061922 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9801fa9d-40a7-408d-ace9-27f9da508323 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:39.062672 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9801fa9d-40a7-408d-ace9-27f9da508323 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:39.069430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9801fa9d-40a7-408d-ace9-27f9da508323 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:39.069914 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9801fa9d-40a7-408d-ace9-27f9da508323 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:39.070351 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9801fa9d-40a7-408d-ace9-27f9da508323 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:39.071074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9801fa9d-40a7-408d-ace9-27f9da508323 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:39.071681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9801fa9d-40a7-408d-ace9-27f9da508323 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:39.072096 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9801fa9d-40a7-408d-ace9-27f9da508323 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:39.293922 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9801fa9d-40a7-408d-ace9-27f9da508323 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:39.303952 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9801fa9d-40a7-408d-ace9-27f9da508323 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1366 microversion: 2.1 time: 0.246814 Sep 15 19:32:39.314891 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 445/714] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:39 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:39.325985 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3b955f6a-d524-49dc-a530-1e4b13b3865a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:39.326610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3b955f6a-d524-49dc-a530-1e4b13b3865a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:39.335593 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b955f6a-d524-49dc-a530-1e4b13b3865a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:39.336119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b955f6a-d524-49dc-a530-1e4b13b3865a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:39.336596 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b955f6a-d524-49dc-a530-1e4b13b3865a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:39.338272 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b955f6a-d524-49dc-a530-1e4b13b3865a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:39.338485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b955f6a-d524-49dc-a530-1e4b13b3865a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:39.338935 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b955f6a-d524-49dc-a530-1e4b13b3865a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:39.722171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3b955f6a-d524-49dc-a530-1e4b13b3865a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:39.748255 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3b955f6a-d524-49dc-a530-1e4b13b3865a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1271 microversion: 2.1 time: 0.420397 Sep 15 19:32:39.748255 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 446/715] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:39 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1271 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:39.754351 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-85700261-4ea5-43ca-bf49-5fd644fd12ba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:39.754602 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-85700261-4ea5-43ca-bf49-5fd644fd12ba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: ced2825e-adc0-4716-88f5-0b0b297b2b21] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:39.769816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-85700261-4ea5-43ca-bf49-5fd644fd12ba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:39.770327 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-85700261-4ea5-43ca-bf49-5fd644fd12ba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:39.770819 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-85700261-4ea5-43ca-bf49-5fd644fd12ba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:39.771724 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-85700261-4ea5-43ca-bf49-5fd644fd12ba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:39.772220 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-85700261-4ea5-43ca-bf49-5fd644fd12ba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:39.772651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-85700261-4ea5-43ca-bf49-5fd644fd12ba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:39.788451 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-85700261-4ea5-43ca-bf49-5fd644fd12ba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] HTTP exception thrown: Instance ced2825e-adc0-4716-88f5-0b0b297b2b21 could not be found. Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-85700261-4ea5-43ca-bf49-5fd644fd12ba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Request method failure captured: Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 HTTP/1.1 Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2gP0Gamuz7MW6kt5fLWKd3NLL-PP3YSW0U9aHiJ2uXiR5ltQi77FsMQyXTqL_ThLEIKacMbb8OOMEUFv5IMw0TOPVnWuEE3VOpC98z4LA6wvz2NMPIxQroKGaTQtiVlHx-Xt0EbiHTVWLkl0p0ZJGv_y0Kwm5RmsVyVsM-g7xfCk Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 016f968319fd49d98506030c0bee6021 Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:32:39.790191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:32:39.792501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_016f968319fd49d98506030c0bee6021", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/016f968319fd49d98506030c0bee6021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/016f968319fd49d98506030c0bee6021"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/016f968319fd49d98506030c0bee6021"}]}] Sep 15 19:32:39.792501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:32:39.792501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 016f968319fd49d98506030c0bee6021 Sep 15 19:32:39.792501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:32:39.792501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-ServerRescueNegativeTestJSON-1036181242-project Sep 15 19:32:39.792501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:32:39.792501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:32:39.792501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 1d7c40b5232e46119434aeeb8a6ad4d0 Sep 15 19:32:39.792501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1036181242-project Sep 15 19:32:39.792501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:32:39.792501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance ced2825e-adc0-4716-88f5-0b0b297b2b21 could not be found. Sep 15 19:32:39.792501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'ced2825e-adc0-4716-88f5-0b0b297b2b21'} Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ced2825e-adc0-4716-88f5-0b0b297b2b21 could not be found. Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:32:39.793998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ced2825e-adc0-4716-88f5-0b0b297b2b21 could not be found. Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ced2825e-adc0-4716-88f5-0b0b297b2b21 could not be found. Sep 15 19:32:39.795712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:39.796867 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-85700261-4ea5-43ca-bf49-5fd644fd12ba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Returning 404 to user: Instance ced2825e-adc0-4716-88f5-0b0b297b2b21 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:32:39.796867 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-85700261-4ea5-43ca-bf49-5fd644fd12ba tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21" status: 404 len: 111 microversion: 2.1 time: 0.052028 Sep 15 19:32:39.796867 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 447/716] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:39 2022] GET /compute/v2.1/servers/ced2825e-adc0-4716-88f5-0b0b297b2b21 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:32:39.802075 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-aa8d43a3-3cf4-44be-b264-96467d4e0684 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:39.802723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-aa8d43a3-3cf4-44be-b264-96467d4e0684 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:39.921064 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-aa8d43a3-3cf4-44be-b264-96467d4e0684 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:39.932481 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-aa8d43a3-3cf4-44be-b264-96467d4e0684 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1238 microversion: 2.1 time: 0.137464 Sep 15 19:32:39.932842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 448/717] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:39 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1238 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:40.098943 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-8586392a-2da1-4f84-b763-0b51a7123caa req-b10970d9-8e03-4513-bd78-8c27ed1fe40e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756ade48-671d-4ee9-84cd-f7b0e0f07712", "tag": "495e3394-0786-4d88-a7ab-ecf29d2c4fe5"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:40.112677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-8586392a-2da1-4f84-b763-0b51a7123caa req-b10970d9-8e03-4513-bd78-8c27ed1fe40e service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:40.113818 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-8586392a-2da1-4f84-b763-0b51a7123caa req-b10970d9-8e03-4513-bd78-8c27ed1fe40e service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:40.114821 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-8586392a-2da1-4f84-b763-0b51a7123caa req-b10970d9-8e03-4513-bd78-8c27ed1fe40e service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:40.127155 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-8586392a-2da1-4f84-b763-0b51a7123caa req-b10970d9-8e03-4513-bd78-8c27ed1fe40e service nova] Creating event network-changed:495e3394-0786-4d88-a7ab-ecf29d2c4fe5 for instance 756ade48-671d-4ee9-84cd-f7b0e0f07712 on hv-cinder-84984 Sep 15 19:32:40.131999 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-8586392a-2da1-4f84-b763-0b51a7123caa req-b10970d9-8e03-4513-bd78-8c27ed1fe40e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197368 Sep 15 19:32:40.132604 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 449/718] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:40.138264 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3f447de3-b591-4611-94d0-9d4f46e376f1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:40.138858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3f447de3-b591-4611-94d0-9d4f46e376f1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:40.145298 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3f447de3-b591-4611-94d0-9d4f46e376f1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:40.145788 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3f447de3-b591-4611-94d0-9d4f46e376f1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:40.146220 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3f447de3-b591-4611-94d0-9d4f46e376f1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:40.147162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3f447de3-b591-4611-94d0-9d4f46e376f1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:40.147618 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3f447de3-b591-4611-94d0-9d4f46e376f1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:40.148081 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3f447de3-b591-4611-94d0-9d4f46e376f1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:40.190067 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3f447de3-b591-4611-94d0-9d4f46e376f1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:32:40.738865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3f447de3-b591-4611-94d0-9d4f46e376f1 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 204 len: 0 microversion: 2.1 time: 0.604730 Sep 15 19:32:40.742865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 450/719] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:32:40 2022] DELETE /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 19:32:40.748794 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b01cb5e9-88db-4675-ac2f-79498d134ad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:40.749513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b01cb5e9-88db-4675-ac2f-79498d134ad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:40.756675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b01cb5e9-88db-4675-ac2f-79498d134ad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:40.757170 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b01cb5e9-88db-4675-ac2f-79498d134ad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:40.757616 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b01cb5e9-88db-4675-ac2f-79498d134ad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:40.758376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b01cb5e9-88db-4675-ac2f-79498d134ad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:40.758841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b01cb5e9-88db-4675-ac2f-79498d134ad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:40.759459 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b01cb5e9-88db-4675-ac2f-79498d134ad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:40.954923 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b01cb5e9-88db-4675-ac2f-79498d134ad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:40.964163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b01cb5e9-88db-4675-ac2f-79498d134ad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1318 microversion: 2.1 time: 0.219703 Sep 15 19:32:40.965113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 451/720] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:40 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:40.970454 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-aa9c23a6-19e2-456f-9833-04c1c049484d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:40.971515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-aa9c23a6-19e2-456f-9833-04c1c049484d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:40.981234 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aa9c23a6-19e2-456f-9833-04c1c049484d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:40.982762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aa9c23a6-19e2-456f-9833-04c1c049484d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:40.982986 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aa9c23a6-19e2-456f-9833-04c1c049484d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:40.983955 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aa9c23a6-19e2-456f-9833-04c1c049484d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:40.984537 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aa9c23a6-19e2-456f-9833-04c1c049484d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:40.985265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aa9c23a6-19e2-456f-9833-04c1c049484d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:41.177377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-aa9c23a6-19e2-456f-9833-04c1c049484d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:41.188762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-aa9c23a6-19e2-456f-9833-04c1c049484d tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1366 microversion: 2.1 time: 0.222148 Sep 15 19:32:41.189435 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 452/721] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:40 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:41.194108 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-09147ed8-573a-41c1-8fef-b6746b9560dc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:41.194709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-09147ed8-573a-41c1-8fef-b6746b9560dc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:41.202413 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-09147ed8-573a-41c1-8fef-b6746b9560dc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:41.202897 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-09147ed8-573a-41c1-8fef-b6746b9560dc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:41.203851 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-09147ed8-573a-41c1-8fef-b6746b9560dc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:41.204611 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-09147ed8-573a-41c1-8fef-b6746b9560dc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:41.205074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-09147ed8-573a-41c1-8fef-b6746b9560dc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:41.205479 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-09147ed8-573a-41c1-8fef-b6746b9560dc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:41.418447 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-09147ed8-573a-41c1-8fef-b6746b9560dc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:41.426674 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-09147ed8-573a-41c1-8fef-b6746b9560dc tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.236207 Sep 15 19:32:41.427726 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 453/722] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:41 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:41.433310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5481856b-0b10-4c80-a1f8-41c9b4414e09 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:41.434397 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5481856b-0b10-4c80-a1f8-41c9b4414e09 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:41.440965 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5481856b-0b10-4c80-a1f8-41c9b4414e09 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:41.441522 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5481856b-0b10-4c80-a1f8-41c9b4414e09 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:41.442020 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5481856b-0b10-4c80-a1f8-41c9b4414e09 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:41.443458 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5481856b-0b10-4c80-a1f8-41c9b4414e09 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:41.443458 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5481856b-0b10-4c80-a1f8-41c9b4414e09 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:41.443711 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5481856b-0b10-4c80-a1f8-41c9b4414e09 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:41.586886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5481856b-0b10-4c80-a1f8-41c9b4414e09 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:41.600253 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5481856b-0b10-4c80-a1f8-41c9b4414e09 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1259 microversion: 2.1 time: 0.171074 Sep 15 19:32:41.601084 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 454/723] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:41 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:41.608725 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-aa3654ea-9e9f-4847-b5d4-f34db603c18e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:41.609763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-aa3654ea-9e9f-4847-b5d4-f34db603c18e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:41.617334 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aa3654ea-9e9f-4847-b5d4-f34db603c18e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:41.617835 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aa3654ea-9e9f-4847-b5d4-f34db603c18e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:41.618267 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aa3654ea-9e9f-4847-b5d4-f34db603c18e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:41.618990 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aa3654ea-9e9f-4847-b5d4-f34db603c18e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:41.619448 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aa3654ea-9e9f-4847-b5d4-f34db603c18e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:41.619944 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aa3654ea-9e9f-4847-b5d4-f34db603c18e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:41.685757 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-aa3654ea-9e9f-4847-b5d4-f34db603c18e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:41.694202 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-aa3654ea-9e9f-4847-b5d4-f34db603c18e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1234 microversion: 2.1 time: 0.091768 Sep 15 19:32:41.694791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 455/724] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:41 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1234 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:41.699351 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-06f98d44-59d3-498c-a856-a0ae4a70578e req-1b355c21-ccc2-4f5d-801c-aab317fbe858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced2825e-adc0-4716-88f5-0b0b297b2b21", "name": "network-vif-deleted", "tag": "b8d23106-0153-4b20-8a66-916ff52a223e"}, {"name": "network-changed", "server_uuid": "eb1a7eec-51a4-496a-a361-cb2e7f0b6f65", "tag": "5d9355ed-482e-4597-88f4-9572e304ef13"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:41.711104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-06f98d44-59d3-498c-a856-a0ae4a70578e req-1b355c21-ccc2-4f5d-801c-aab317fbe858 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:41.711574 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-06f98d44-59d3-498c-a856-a0ae4a70578e req-1b355c21-ccc2-4f5d-801c-aab317fbe858 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:41.712027 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-06f98d44-59d3-498c-a856-a0ae4a70578e req-1b355c21-ccc2-4f5d-801c-aab317fbe858 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:41.730649 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-06f98d44-59d3-498c-a856-a0ae4a70578e req-1b355c21-ccc2-4f5d-801c-aab317fbe858 service nova] Creating event network-vif-deleted:b8d23106-0153-4b20-8a66-916ff52a223e for instance ced2825e-adc0-4716-88f5-0b0b297b2b21 on hv-cinder-84984 Sep 15 19:32:41.731148 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-06f98d44-59d3-498c-a856-a0ae4a70578e req-1b355c21-ccc2-4f5d-801c-aab317fbe858 service nova] Creating event network-changed:5d9355ed-482e-4597-88f4-9572e304ef13 for instance eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 on hv-cinder-84984 Sep 15 19:32:41.737512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-06f98d44-59d3-498c-a856-a0ae4a70578e req-1b355c21-ccc2-4f5d-801c-aab317fbe858 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041509 Sep 15 19:32:41.738107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 456/725] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:41.989484 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5b898680-d350-4b74-a50f-3457ed6d6469 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:41.990343 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5b898680-d350-4b74-a50f-3457ed6d6469 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:41.997248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b898680-d350-4b74-a50f-3457ed6d6469 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:41.997697 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b898680-d350-4b74-a50f-3457ed6d6469 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:41.998127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b898680-d350-4b74-a50f-3457ed6d6469 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:41.998811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b898680-d350-4b74-a50f-3457ed6d6469 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:41.999255 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b898680-d350-4b74-a50f-3457ed6d6469 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:41.999690 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b898680-d350-4b74-a50f-3457ed6d6469 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:42.153601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5b898680-d350-4b74-a50f-3457ed6d6469 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:42.162355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5b898680-d350-4b74-a50f-3457ed6d6469 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1318 microversion: 2.1 time: 0.177842 Sep 15 19:32:42.162955 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 457/726] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:41 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:42.222971 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3ad33925-e9d0-4202-87bd-63abdb275663 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:42.223738 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3ad33925-e9d0-4202-87bd-63abdb275663 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:42.230368 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ad33925-e9d0-4202-87bd-63abdb275663 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:42.230932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ad33925-e9d0-4202-87bd-63abdb275663 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:42.231409 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ad33925-e9d0-4202-87bd-63abdb275663 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:42.232183 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ad33925-e9d0-4202-87bd-63abdb275663 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:42.232643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ad33925-e9d0-4202-87bd-63abdb275663 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:42.236747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ad33925-e9d0-4202-87bd-63abdb275663 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:42.383934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3ad33925-e9d0-4202-87bd-63abdb275663 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:42.396732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3ad33925-e9d0-4202-87bd-63abdb275663 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1366 microversion: 2.1 time: 0.179365 Sep 15 19:32:42.397577 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 458/727] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:42 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:42.452172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cf758593-71c2-41e7-80c1-2806824e72b5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:42.453043 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cf758593-71c2-41e7-80c1-2806824e72b5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:42.460506 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf758593-71c2-41e7-80c1-2806824e72b5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:42.461277 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf758593-71c2-41e7-80c1-2806824e72b5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:42.461998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf758593-71c2-41e7-80c1-2806824e72b5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:42.462945 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf758593-71c2-41e7-80c1-2806824e72b5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:42.463495 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf758593-71c2-41e7-80c1-2806824e72b5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:42.464134 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf758593-71c2-41e7-80c1-2806824e72b5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:42.629948 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cf758593-71c2-41e7-80c1-2806824e72b5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:42.638394 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cf758593-71c2-41e7-80c1-2806824e72b5 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.191340 Sep 15 19:32:42.639089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 459/728] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:42 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:42.706444 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-2f3bf9ea-e51b-48ac-99af-6fa6fcd6ce1b req-0ae2f2e8-9ef7-4330-a1c0-376bea17692c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c1a3e2-eab3-4cc3-b737-d88f242ecb62", "name": "network-vif-plugged", "status": "completed", "tag": "7433f2f7-bf4d-4108-9055-048e5b317dbb"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:42.716176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2f3bf9ea-e51b-48ac-99af-6fa6fcd6ce1b req-0ae2f2e8-9ef7-4330-a1c0-376bea17692c service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:42.716655 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2f3bf9ea-e51b-48ac-99af-6fa6fcd6ce1b req-0ae2f2e8-9ef7-4330-a1c0-376bea17692c service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:42.717082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2f3bf9ea-e51b-48ac-99af-6fa6fcd6ce1b req-0ae2f2e8-9ef7-4330-a1c0-376bea17692c service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:42.729239 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-2f3bf9ea-e51b-48ac-99af-6fa6fcd6ce1b req-0ae2f2e8-9ef7-4330-a1c0-376bea17692c service nova] Creating event network-vif-plugged:7433f2f7-bf4d-4108-9055-048e5b317dbb for instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 on hv-cinder-84984 Sep 15 19:32:42.735034 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-2f3bf9ea-e51b-48ac-99af-6fa6fcd6ce1b req-0ae2f2e8-9ef7-4330-a1c0-376bea17692c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093736 Sep 15 19:32:42.735034 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 460/729] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:42.740229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fd44ae63-8bd1-4d04-a67a-4a8ae8c96726 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:42.740972 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fd44ae63-8bd1-4d04-a67a-4a8ae8c96726 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:42.748773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd44ae63-8bd1-4d04-a67a-4a8ae8c96726 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:42.749324 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd44ae63-8bd1-4d04-a67a-4a8ae8c96726 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:42.749803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd44ae63-8bd1-4d04-a67a-4a8ae8c96726 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:42.750565 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd44ae63-8bd1-4d04-a67a-4a8ae8c96726 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:42.751028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd44ae63-8bd1-4d04-a67a-4a8ae8c96726 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:42.751454 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd44ae63-8bd1-4d04-a67a-4a8ae8c96726 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:42.912498 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fd44ae63-8bd1-4d04-a67a-4a8ae8c96726 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:42.920875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fd44ae63-8bd1-4d04-a67a-4a8ae8c96726 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1259 microversion: 2.1 time: 0.184786 Sep 15 19:32:42.921583 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 461/730] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:42 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:42.926593 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0fda4a2d-1875-451f-9dd5-e977fe135811 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:42.927431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0fda4a2d-1875-451f-9dd5-e977fe135811 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:42.934293 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fda4a2d-1875-451f-9dd5-e977fe135811 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:42.935775 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fda4a2d-1875-451f-9dd5-e977fe135811 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:42.938229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fda4a2d-1875-451f-9dd5-e977fe135811 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:42.938994 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fda4a2d-1875-451f-9dd5-e977fe135811 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:42.939462 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fda4a2d-1875-451f-9dd5-e977fe135811 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:42.939923 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fda4a2d-1875-451f-9dd5-e977fe135811 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:43.011602 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0fda4a2d-1875-451f-9dd5-e977fe135811 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:43.020414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0fda4a2d-1875-451f-9dd5-e977fe135811 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1234 microversion: 2.1 time: 0.097782 Sep 15 19:32:43.020991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 462/731] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:42 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1234 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:43.186512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bcc56986-23d7-43d4-af9f-bf666eda3dba tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:43.187112 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bcc56986-23d7-43d4-af9f-bf666eda3dba tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:43.193851 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bcc56986-23d7-43d4-af9f-bf666eda3dba tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:43.194333 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bcc56986-23d7-43d4-af9f-bf666eda3dba tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:43.194765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bcc56986-23d7-43d4-af9f-bf666eda3dba tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:43.195459 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bcc56986-23d7-43d4-af9f-bf666eda3dba tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:43.195929 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bcc56986-23d7-43d4-af9f-bf666eda3dba tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:43.199126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bcc56986-23d7-43d4-af9f-bf666eda3dba tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:43.200414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:43.334271 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bcc56986-23d7-43d4-af9f-bf666eda3dba tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:43.341960 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bcc56986-23d7-43d4-af9f-bf666eda3dba tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1318 microversion: 2.1 time: 0.159436 Sep 15 19:32:43.342453 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 463/732] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:43 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:43.423865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-991c7748-8aa7-4ede-bd28-7ecaad53b99e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:43.424509 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-991c7748-8aa7-4ede-bd28-7ecaad53b99e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:43.432056 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-991c7748-8aa7-4ede-bd28-7ecaad53b99e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:43.432539 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-991c7748-8aa7-4ede-bd28-7ecaad53b99e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:43.432975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-991c7748-8aa7-4ede-bd28-7ecaad53b99e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:43.433723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-991c7748-8aa7-4ede-bd28-7ecaad53b99e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:43.434176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-991c7748-8aa7-4ede-bd28-7ecaad53b99e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:43.434598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-991c7748-8aa7-4ede-bd28-7ecaad53b99e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:43.712851 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-991c7748-8aa7-4ede-bd28-7ecaad53b99e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:43.728945 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-991c7748-8aa7-4ede-bd28-7ecaad53b99e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1366 microversion: 2.1 time: 0.309429 Sep 15 19:32:43.729609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 464/733] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:43 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:43.734016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-22b588ad-558c-452d-983c-5578918908fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:43.735189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-22b588ad-558c-452d-983c-5578918908fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:43.741548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22b588ad-558c-452d-983c-5578918908fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:43.742046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22b588ad-558c-452d-983c-5578918908fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:43.742481 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22b588ad-558c-452d-983c-5578918908fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:43.743171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22b588ad-558c-452d-983c-5578918908fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:43.743624 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22b588ad-558c-452d-983c-5578918908fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:43.744082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22b588ad-558c-452d-983c-5578918908fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:43.876551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-22b588ad-558c-452d-983c-5578918908fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:43.884344 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-22b588ad-558c-452d-983c-5578918908fe tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1522 microversion: 2.1 time: 0.153825 Sep 15 19:32:43.884913 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 465/734] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:43 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:43.944820 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-37ac9835-95bf-43de-b7ad-c05a6579b467 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:44.113640 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-37ac9835-95bf-43de-b7ad-c05a6579b467 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:44.113640 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-37ac9835-95bf-43de-b7ad-c05a6579b467 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:44.113640 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-37ac9835-95bf-43de-b7ad-c05a6579b467 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:44.113640 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-37ac9835-95bf-43de-b7ad-c05a6579b467 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:44.116215 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-37ac9835-95bf-43de-b7ad-c05a6579b467 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:44.116215 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-37ac9835-95bf-43de-b7ad-c05a6579b467 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:44.116215 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-37ac9835-95bf-43de-b7ad-c05a6579b467 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:44.285805 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-37ac9835-95bf-43de-b7ad-c05a6579b467 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:44.296149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-37ac9835-95bf-43de-b7ad-c05a6579b467 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1259 microversion: 2.1 time: 0.355160 Sep 15 19:32:44.296918 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 466/735] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:43 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1259 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:44.301663 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-74b9b038-33a1-47f5-87c3-a38f3ecb2abd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:44.302313 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-74b9b038-33a1-47f5-87c3-a38f3ecb2abd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:44.308718 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-74b9b038-33a1-47f5-87c3-a38f3ecb2abd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:44.319150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-74b9b038-33a1-47f5-87c3-a38f3ecb2abd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:44.319150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-74b9b038-33a1-47f5-87c3-a38f3ecb2abd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:44.319150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-74b9b038-33a1-47f5-87c3-a38f3ecb2abd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:44.319150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-74b9b038-33a1-47f5-87c3-a38f3ecb2abd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:44.319774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-74b9b038-33a1-47f5-87c3-a38f3ecb2abd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:44.389799 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-74b9b038-33a1-47f5-87c3-a38f3ecb2abd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:44.399318 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-74b9b038-33a1-47f5-87c3-a38f3ecb2abd tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1290 microversion: 2.1 time: 0.101331 Sep 15 19:32:44.400353 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 467/736] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:44 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:44.404660 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a14bb3db-3e87-4ef9-a343-3b5332cc40c2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:44.405343 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a14bb3db-3e87-4ef9-a343-3b5332cc40c2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:44.416222 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a14bb3db-3e87-4ef9-a343-3b5332cc40c2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:44.416963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a14bb3db-3e87-4ef9-a343-3b5332cc40c2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:44.417413 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a14bb3db-3e87-4ef9-a343-3b5332cc40c2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:44.418114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a14bb3db-3e87-4ef9-a343-3b5332cc40c2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:44.419732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a14bb3db-3e87-4ef9-a343-3b5332cc40c2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:44.419732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a14bb3db-3e87-4ef9-a343-3b5332cc40c2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:44.560370 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a14bb3db-3e87-4ef9-a343-3b5332cc40c2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:44.570977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a14bb3db-3e87-4ef9-a343-3b5332cc40c2 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1318 microversion: 2.1 time: 0.169761 Sep 15 19:32:44.582294 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 468/737] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:44 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:44.656474 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-c18830ca-7bdb-4d45-a446-80ab6d06dd5b req-adf0f3ef-b16d-4b53-a756-1a5a526c4132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b36131f-5f27-419f-b1b2-da2d6ebc60e5", "name": "network-vif-deleted", "tag": "df8bdaca-d337-4c5a-a11c-dbedba1578a8"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:44.667274 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c18830ca-7bdb-4d45-a446-80ab6d06dd5b req-adf0f3ef-b16d-4b53-a756-1a5a526c4132 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:44.667767 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c18830ca-7bdb-4d45-a446-80ab6d06dd5b req-adf0f3ef-b16d-4b53-a756-1a5a526c4132 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:44.668193 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c18830ca-7bdb-4d45-a446-80ab6d06dd5b req-adf0f3ef-b16d-4b53-a756-1a5a526c4132 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:44.681533 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-c18830ca-7bdb-4d45-a446-80ab6d06dd5b req-adf0f3ef-b16d-4b53-a756-1a5a526c4132 service nova] Creating event network-vif-deleted:df8bdaca-d337-4c5a-a11c-dbedba1578a8 for instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 on hv-cinder-84984 Sep 15 19:32:44.691816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-c18830ca-7bdb-4d45-a446-80ab6d06dd5b req-adf0f3ef-b16d-4b53-a756-1a5a526c4132 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034710 Sep 15 19:32:44.691816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 469/738] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:32:44.756986 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c233ba2b-3aa2-4be1-8573-dcbeed220a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:44.760522 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c233ba2b-3aa2-4be1-8573-dcbeed220a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:44.766471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c233ba2b-3aa2-4be1-8573-dcbeed220a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:44.766950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c233ba2b-3aa2-4be1-8573-dcbeed220a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:44.767377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c233ba2b-3aa2-4be1-8573-dcbeed220a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:44.768479 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c233ba2b-3aa2-4be1-8573-dcbeed220a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:44.769080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c233ba2b-3aa2-4be1-8573-dcbeed220a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:44.769838 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c233ba2b-3aa2-4be1-8573-dcbeed220a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:44.915796 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c233ba2b-3aa2-4be1-8573-dcbeed220a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:44.924035 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c233ba2b-3aa2-4be1-8573-dcbeed220a12 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1366 microversion: 2.1 time: 0.173835 Sep 15 19:32:44.924628 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 470/739] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:44 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:44.938549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-623b4c70-71d0-4cff-ac0f-6602293db620 req-0f1455e4-fcb6-4c78-b7c7-7f99cc69d957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756ade48-671d-4ee9-84cd-f7b0e0f07712", "name": "network-vif-plugged", "status": "completed", "tag": "495e3394-0786-4d88-a7ab-ecf29d2c4fe5"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:44.961542 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-623b4c70-71d0-4cff-ac0f-6602293db620 req-0f1455e4-fcb6-4c78-b7c7-7f99cc69d957 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:44.961542 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-623b4c70-71d0-4cff-ac0f-6602293db620 req-0f1455e4-fcb6-4c78-b7c7-7f99cc69d957 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:44.961542 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-623b4c70-71d0-4cff-ac0f-6602293db620 req-0f1455e4-fcb6-4c78-b7c7-7f99cc69d957 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:44.974153 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-623b4c70-71d0-4cff-ac0f-6602293db620 req-0f1455e4-fcb6-4c78-b7c7-7f99cc69d957 service nova] Creating event network-vif-plugged:495e3394-0786-4d88-a7ab-ecf29d2c4fe5 for instance 756ade48-671d-4ee9-84cd-f7b0e0f07712 on hv-cinder-84984 Sep 15 19:32:44.979465 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-623b4c70-71d0-4cff-ac0f-6602293db620 req-0f1455e4-fcb6-4c78-b7c7-7f99cc69d957 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053190 Sep 15 19:32:44.980688 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 471/740] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:44.987616 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-836799c0-f292-41aa-b22d-5634607f7cb6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:44.988294 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-836799c0-f292-41aa-b22d-5634607f7cb6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:44.994766 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-836799c0-f292-41aa-b22d-5634607f7cb6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:44.995243 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-836799c0-f292-41aa-b22d-5634607f7cb6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:44.995727 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-836799c0-f292-41aa-b22d-5634607f7cb6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:44.996432 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-836799c0-f292-41aa-b22d-5634607f7cb6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:44.996876 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-836799c0-f292-41aa-b22d-5634607f7cb6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:44.997307 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-836799c0-f292-41aa-b22d-5634607f7cb6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:45.067595 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-836799c0-f292-41aa-b22d-5634607f7cb6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:45.076632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-836799c0-f292-41aa-b22d-5634607f7cb6 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1307 microversion: 2.1 time: 0.094541 Sep 15 19:32:45.077803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 472/741] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:44 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:45.322099 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-af346665-689b-456e-8cac-c33f73a5a734 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:45.322837 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-af346665-689b-456e-8cac-c33f73a5a734 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:45.329273 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af346665-689b-456e-8cac-c33f73a5a734 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:45.329751 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af346665-689b-456e-8cac-c33f73a5a734 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:45.330183 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af346665-689b-456e-8cac-c33f73a5a734 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:45.330877 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af346665-689b-456e-8cac-c33f73a5a734 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:45.331377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af346665-689b-456e-8cac-c33f73a5a734 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:45.331771 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af346665-689b-456e-8cac-c33f73a5a734 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:45.466085 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-af346665-689b-456e-8cac-c33f73a5a734 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:45.474704 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-af346665-689b-456e-8cac-c33f73a5a734 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1259 microversion: 2.1 time: 0.156432 Sep 15 19:32:45.475274 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 473/742] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:45 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:45.479766 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e598fd69-6bb3-4b0b-ae6d-3d5fa86184a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:45.480370 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e598fd69-6bb3-4b0b-ae6d-3d5fa86184a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:45.486751 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e598fd69-6bb3-4b0b-ae6d-3d5fa86184a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:45.487238 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e598fd69-6bb3-4b0b-ae6d-3d5fa86184a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:45.487694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e598fd69-6bb3-4b0b-ae6d-3d5fa86184a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:45.488390 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e598fd69-6bb3-4b0b-ae6d-3d5fa86184a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:45.488838 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e598fd69-6bb3-4b0b-ae6d-3d5fa86184a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:45.489260 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e598fd69-6bb3-4b0b-ae6d-3d5fa86184a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:45.552517 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e598fd69-6bb3-4b0b-ae6d-3d5fa86184a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:45.561050 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e598fd69-6bb3-4b0b-ae6d-3d5fa86184a7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1308 microversion: 2.1 time: 0.084726 Sep 15 19:32:45.561630 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 474/743] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:45 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1308 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:45.598132 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bfba2bcb-2ac5-4da2-9ec1-907cbc7a92b0 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:45.598754 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bfba2bcb-2ac5-4da2-9ec1-907cbc7a92b0 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:45.601925 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:45.606222 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bfba2bcb-2ac5-4da2-9ec1-907cbc7a92b0 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:45.606715 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bfba2bcb-2ac5-4da2-9ec1-907cbc7a92b0 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:45.607144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bfba2bcb-2ac5-4da2-9ec1-907cbc7a92b0 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:45.607872 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bfba2bcb-2ac5-4da2-9ec1-907cbc7a92b0 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:45.608795 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bfba2bcb-2ac5-4da2-9ec1-907cbc7a92b0 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:45.609354 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bfba2bcb-2ac5-4da2-9ec1-907cbc7a92b0 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:45.852313 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bfba2bcb-2ac5-4da2-9ec1-907cbc7a92b0 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:45.857899 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bfba2bcb-2ac5-4da2-9ec1-907cbc7a92b0 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1318 microversion: 2.1 time: 0.265250 Sep 15 19:32:45.858510 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 475/744] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:45 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:45.948890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b3d87c7a-fa76-44d3-a839-30f0006957d6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:45.949658 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b3d87c7a-fa76-44d3-a839-30f0006957d6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:45.959713 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3d87c7a-fa76-44d3-a839-30f0006957d6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:45.960503 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3d87c7a-fa76-44d3-a839-30f0006957d6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:45.960968 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3d87c7a-fa76-44d3-a839-30f0006957d6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:45.974882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3d87c7a-fa76-44d3-a839-30f0006957d6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:45.975363 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3d87c7a-fa76-44d3-a839-30f0006957d6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:45.975839 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3d87c7a-fa76-44d3-a839-30f0006957d6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:46.254250 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b3d87c7a-fa76-44d3-a839-30f0006957d6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:46.262630 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b3d87c7a-fa76-44d3-a839-30f0006957d6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1555 microversion: 2.1 time: 0.318749 Sep 15 19:32:46.263226 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 476/745] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:45 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1555 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:46.268553 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:46.269166 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:46.275370 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:46.280675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:46.280675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:46.280675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:46.280675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:46.281142 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:46.314671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:46.315215 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:46.315681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:46.316123 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lazy-loading 'fault' on Instance uuid 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:32:46.433250 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:46.442648 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b0ca3e3c-dfe0-48d8-b6fb-d0a2aaf04de2 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1312 microversion: 2.1 time: 0.178352 Sep 15 19:32:46.447135 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 477/746] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:46 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:46.456947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6be2c791-41cb-4e7d-a2c4-b799c5e42bce tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:46.457636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6be2c791-41cb-4e7d-a2c4-b799c5e42bce tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:46.467082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6be2c791-41cb-4e7d-a2c4-b799c5e42bce tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:46.467634 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6be2c791-41cb-4e7d-a2c4-b799c5e42bce tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:46.468177 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6be2c791-41cb-4e7d-a2c4-b799c5e42bce tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:46.468976 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6be2c791-41cb-4e7d-a2c4-b799c5e42bce tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:46.469642 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6be2c791-41cb-4e7d-a2c4-b799c5e42bce tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:46.470177 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6be2c791-41cb-4e7d-a2c4-b799c5e42bce tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:46.592743 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6be2c791-41cb-4e7d-a2c4-b799c5e42bce tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148000 Sep 15 19:32:46.593351 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 478/747] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 15 19:32:46 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:46.598238 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fb2e766a-a929-4abf-acbf-52ed28e0be8d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:46.603192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fb2e766a-a929-4abf-acbf-52ed28e0be8d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:46.607741 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb2e766a-a929-4abf-acbf-52ed28e0be8d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:46.608351 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb2e766a-a929-4abf-acbf-52ed28e0be8d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:46.609039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb2e766a-a929-4abf-acbf-52ed28e0be8d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:46.610313 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb2e766a-a929-4abf-acbf-52ed28e0be8d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:46.610989 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb2e766a-a929-4abf-acbf-52ed28e0be8d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:46.611388 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb2e766a-a929-4abf-acbf-52ed28e0be8d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:46.920328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fb2e766a-a929-4abf-acbf-52ed28e0be8d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:46.937880 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fb2e766a-a929-4abf-acbf-52ed28e0be8d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1259 microversion: 2.1 time: 0.343256 Sep 15 19:32:46.939047 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 479/748] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:46 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1259 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:46.948504 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cc636625-34da-41f3-83f9-3c92c9464756 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:46.949499 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cc636625-34da-41f3-83f9-3c92c9464756 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:46.958706 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc636625-34da-41f3-83f9-3c92c9464756 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:46.963934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc636625-34da-41f3-83f9-3c92c9464756 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:46.963934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc636625-34da-41f3-83f9-3c92c9464756 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:46.963934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc636625-34da-41f3-83f9-3c92c9464756 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:46.963934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc636625-34da-41f3-83f9-3c92c9464756 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:46.964325 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc636625-34da-41f3-83f9-3c92c9464756 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:47.030724 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cc636625-34da-41f3-83f9-3c92c9464756 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:47.039886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cc636625-34da-41f3-83f9-3c92c9464756 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1296 microversion: 2.1 time: 0.099339 Sep 15 19:32:47.040429 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 480/749] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:46 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:47.045455 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d417fa17-65ac-4d54-8d63-07ec7def7684 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:47.046335 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d417fa17-65ac-4d54-8d63-07ec7def7684 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:47.055317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d417fa17-65ac-4d54-8d63-07ec7def7684 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:47.056171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d417fa17-65ac-4d54-8d63-07ec7def7684 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:47.056614 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d417fa17-65ac-4d54-8d63-07ec7def7684 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:47.057330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d417fa17-65ac-4d54-8d63-07ec7def7684 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:47.057783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d417fa17-65ac-4d54-8d63-07ec7def7684 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:47.058205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d417fa17-65ac-4d54-8d63-07ec7def7684 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:47.063518 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:47.408520 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d417fa17-65ac-4d54-8d63-07ec7def7684 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:47.414589 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d417fa17-65ac-4d54-8d63-07ec7def7684 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1318 microversion: 2.1 time: 0.373099 Sep 15 19:32:47.415173 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 481/750] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:47 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:47.467835 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:47.468514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:47.485041 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:47.485517 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:47.485955 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:47.486669 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:47.487119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:47.487546 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:47.526735 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:47.527241 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:47.528112 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:47.528578 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lazy-loading 'fault' on Instance uuid 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:32:47.587410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7c40b5232e46119434aeeb8a6ad4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016f968319fd49d98506030c0bee6021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:47.595286 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-08c07460-1439-4f94-9739-c1aaa5557452 tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 200 len: 1312 microversion: 2.1 time: 0.132634 Sep 15 19:32:47.597562 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 482/751] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:47 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 1312 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:47.961987 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-56cf852d-92ab-4aa7-af65-f9e695d7ab6c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:47.962978 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-56cf852d-92ab-4aa7-af65-f9e695d7ab6c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:47.969934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56cf852d-92ab-4aa7-af65-f9e695d7ab6c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:47.970526 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56cf852d-92ab-4aa7-af65-f9e695d7ab6c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:47.971073 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56cf852d-92ab-4aa7-af65-f9e695d7ab6c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:47.971935 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56cf852d-92ab-4aa7-af65-f9e695d7ab6c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:47.972491 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56cf852d-92ab-4aa7-af65-f9e695d7ab6c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:47.973013 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56cf852d-92ab-4aa7-af65-f9e695d7ab6c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:48.225860 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-56cf852d-92ab-4aa7-af65-f9e695d7ab6c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:48.236039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-56cf852d-92ab-4aa7-af65-f9e695d7ab6c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1259 microversion: 2.1 time: 0.277761 Sep 15 19:32:48.236897 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 483/752] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:47 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1259 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:48.242867 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-913d2551-8d18-4b1c-a960-85999a19e080 req-461e51c1-20b6-45d1-a57f-a71f5f99ff96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c1a3e2-eab3-4cc3-b737-d88f242ecb62", "tag": "7433f2f7-bf4d-4108-9055-048e5b317dbb"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:48.252895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-913d2551-8d18-4b1c-a960-85999a19e080 req-461e51c1-20b6-45d1-a57f-a71f5f99ff96 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:48.253373 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-913d2551-8d18-4b1c-a960-85999a19e080 req-461e51c1-20b6-45d1-a57f-a71f5f99ff96 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:48.253801 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-913d2551-8d18-4b1c-a960-85999a19e080 req-461e51c1-20b6-45d1-a57f-a71f5f99ff96 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:48.266608 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-913d2551-8d18-4b1c-a960-85999a19e080 req-461e51c1-20b6-45d1-a57f-a71f5f99ff96 service nova] Creating event network-changed:7433f2f7-bf4d-4108-9055-048e5b317dbb for instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 on hv-cinder-84984 Sep 15 19:32:48.271698 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-913d2551-8d18-4b1c-a960-85999a19e080 req-461e51c1-20b6-45d1-a57f-a71f5f99ff96 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033438 Sep 15 19:32:48.272315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 484/753] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:48.282421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ece4d143-2c51-48b2-8999-0d5698c1158c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:48.285220 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ece4d143-2c51-48b2-8999-0d5698c1158c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:48.290340 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ece4d143-2c51-48b2-8999-0d5698c1158c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:48.290837 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ece4d143-2c51-48b2-8999-0d5698c1158c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:48.291248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ece4d143-2c51-48b2-8999-0d5698c1158c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:48.291989 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ece4d143-2c51-48b2-8999-0d5698c1158c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:48.292436 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ece4d143-2c51-48b2-8999-0d5698c1158c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:48.292854 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ece4d143-2c51-48b2-8999-0d5698c1158c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:48.425252 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=8 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:48.554066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ece4d143-2c51-48b2-8999-0d5698c1158c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:48.563527 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ece4d143-2c51-48b2-8999-0d5698c1158c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1363 microversion: 2.1 time: 0.288100 Sep 15 19:32:48.567172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 485/754] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:48 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:48.570277 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c24e83d7-bd1a-4d2a-afb1-9da6b57cd5fa tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:48.571090 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c24e83d7-bd1a-4d2a-afb1-9da6b57cd5fa tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:48.585022 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c24e83d7-bd1a-4d2a-afb1-9da6b57cd5fa tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:48.585666 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c24e83d7-bd1a-4d2a-afb1-9da6b57cd5fa tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:48.586113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c24e83d7-bd1a-4d2a-afb1-9da6b57cd5fa tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:48.586856 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c24e83d7-bd1a-4d2a-afb1-9da6b57cd5fa tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:48.587385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c24e83d7-bd1a-4d2a-afb1-9da6b57cd5fa tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:48.587840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c24e83d7-bd1a-4d2a-afb1-9da6b57cd5fa tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:48.917206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c24e83d7-bd1a-4d2a-afb1-9da6b57cd5fa tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:48.930431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c24e83d7-bd1a-4d2a-afb1-9da6b57cd5fa tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1507 microversion: 2.1 time: 0.365008 Sep 15 19:32:48.944501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 486/755] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:48 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:48.944501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1e2b16ee-b2f3-4646-8ea9-49b56f292dee tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:48.944501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1e2b16ee-b2f3-4646-8ea9-49b56f292dee tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] [instance: 1b36131f-5f27-419f-b1b2-da2d6ebc60e5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:48.944501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e2b16ee-b2f3-4646-8ea9-49b56f292dee tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:48.945338 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e2b16ee-b2f3-4646-8ea9-49b56f292dee tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:48.945338 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e2b16ee-b2f3-4646-8ea9-49b56f292dee tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:48.945629 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e2b16ee-b2f3-4646-8ea9-49b56f292dee tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:48.946094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e2b16ee-b2f3-4646-8ea9-49b56f292dee tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:48.947698 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e2b16ee-b2f3-4646-8ea9-49b56f292dee tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:48.965448 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-1e2b16ee-b2f3-4646-8ea9-49b56f292dee tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] HTTP exception thrown: Instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 could not be found. Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1e2b16ee-b2f3-4646-8ea9-49b56f292dee tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Request method failure captured: Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 HTTP/1.1 Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2gP0Gamuz7MW6kt5fLWKd3NLL-PP3YSW0U9aHiJ2uXiR5ltQi77FsMQyXTqL_ThLEIKacMbb8OOMEUFv5IMw0TOPVnWuEE3VOpC98z4LA6wvz2NMPIxQroKGaTQtiVlHx-Xt0EbiHTVWLkl0p0ZJGv_y0Kwm5RmsVyVsM-g7xfCk Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 016f968319fd49d98506030c0bee6021 Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:32:48.967249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:32:48.969528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_016f968319fd49d98506030c0bee6021", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/016f968319fd49d98506030c0bee6021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/016f968319fd49d98506030c0bee6021"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/016f968319fd49d98506030c0bee6021"}]}] Sep 15 19:32:48.969528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:32:48.969528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 016f968319fd49d98506030c0bee6021 Sep 15 19:32:48.969528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1036181242 Sep 15 19:32:48.969528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-ServerRescueNegativeTestJSON-1036181242-project Sep 15 19:32:48.969528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:32:48.969528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:32:48.969528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 1d7c40b5232e46119434aeeb8a6ad4d0 Sep 15 19:32:48.969528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1036181242-project Sep 15 19:32:48.969528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:32:48.969528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 could not be found. Sep 15 19:32:48.969528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '1b36131f-5f27-419f-b1b2-da2d6ebc60e5'} Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 could not be found. Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:32:48.970493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 could not be found. Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 could not be found. Sep 15 19:32:48.972059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:32:48.973409 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1e2b16ee-b2f3-4646-8ea9-49b56f292dee tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] Returning 404 to user: Instance 1b36131f-5f27-419f-b1b2-da2d6ebc60e5 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:32:48.973409 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1e2b16ee-b2f3-4646-8ea9-49b56f292dee tempest-ServerRescueNegativeTestJSON-1036181242 tempest-ServerRescueNegativeTestJSON-1036181242-project] 10.222.0.18 "GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5" status: 404 len: 111 microversion: 2.1 time: 0.039598 Sep 15 19:32:48.974647 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 487/756] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:48 2022] GET /compute/v2.1/servers/1b36131f-5f27-419f-b1b2-da2d6ebc60e5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:32:48.979934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-106515f4-cb3f-4873-a66e-b651ed1d7763 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25628d44-abc9-4c10-8e85-2e88a0ce7b46", "device": "/dev/sdb"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:48.983624 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-106515f4-cb3f-4873-a66e-b651ed1d7763 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:48.990377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-106515f4-cb3f-4873-a66e-b651ed1d7763 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:48.992300 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-106515f4-cb3f-4873-a66e-b651ed1d7763 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:48.992300 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-106515f4-cb3f-4873-a66e-b651ed1d7763 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:48.992300 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-106515f4-cb3f-4873-a66e-b651ed1d7763 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:48.993110 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-106515f4-cb3f-4873-a66e-b651ed1d7763 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:48.993370 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-106515f4-cb3f-4873-a66e-b651ed1d7763 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:49.930895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=40 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:49.995512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-106515f4-cb3f-4873-a66e-b651ed1d7763 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "POST /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.019379 Sep 15 19:32:49.996289 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 488/757] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:32:48 2022] POST /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712/os-volume_attachments => generated 194 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:50.002222 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ce19e5f5-7b2f-4c66-8a30-35dda8e5c5b6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:50.005490 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ce19e5f5-7b2f-4c66-8a30-35dda8e5c5b6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:50.011998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce19e5f5-7b2f-4c66-8a30-35dda8e5c5b6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:50.012562 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce19e5f5-7b2f-4c66-8a30-35dda8e5c5b6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:50.013003 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce19e5f5-7b2f-4c66-8a30-35dda8e5c5b6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:50.013712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce19e5f5-7b2f-4c66-8a30-35dda8e5c5b6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:50.014163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce19e5f5-7b2f-4c66-8a30-35dda8e5c5b6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:50.014587 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce19e5f5-7b2f-4c66-8a30-35dda8e5c5b6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:50.156046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ce19e5f5-7b2f-4c66-8a30-35dda8e5c5b6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:50.164474 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ce19e5f5-7b2f-4c66-8a30-35dda8e5c5b6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1259 microversion: 2.1 time: 0.166826 Sep 15 19:32:50.165534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 489/758] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:49 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:50.170446 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-ff6b568d-ac3e-41a7-a2fe-be340fd720ab req-c9ffe8ad-afa1-447c-a597-d75fc352805b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0bedbd2-0142-4af2-a367-257352a283a5", "tag": "bd84b30a-cc10-459e-ab2e-bf61f225c610"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:50.180802 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ff6b568d-ac3e-41a7-a2fe-be340fd720ab req-c9ffe8ad-afa1-447c-a597-d75fc352805b service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:50.181445 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ff6b568d-ac3e-41a7-a2fe-be340fd720ab req-c9ffe8ad-afa1-447c-a597-d75fc352805b service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:50.181870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ff6b568d-ac3e-41a7-a2fe-be340fd720ab req-c9ffe8ad-afa1-447c-a597-d75fc352805b service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:50.199913 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-ff6b568d-ac3e-41a7-a2fe-be340fd720ab req-c9ffe8ad-afa1-447c-a597-d75fc352805b service nova] Creating event network-changed:bd84b30a-cc10-459e-ab2e-bf61f225c610 for instance d0bedbd2-0142-4af2-a367-257352a283a5 on hv-cinder-84984 Sep 15 19:32:50.205282 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-ff6b568d-ac3e-41a7-a2fe-be340fd720ab req-c9ffe8ad-afa1-447c-a597-d75fc352805b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038198 Sep 15 19:32:50.205994 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 490/759] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:50.211294 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7afdd2d1-9c99-45e5-b1e9-9fb7e50cb4d5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:50.212027 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7afdd2d1-9c99-45e5-b1e9-9fb7e50cb4d5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:50.220004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7afdd2d1-9c99-45e5-b1e9-9fb7e50cb4d5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:50.224076 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7afdd2d1-9c99-45e5-b1e9-9fb7e50cb4d5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:50.224076 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7afdd2d1-9c99-45e5-b1e9-9fb7e50cb4d5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:50.224076 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7afdd2d1-9c99-45e5-b1e9-9fb7e50cb4d5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:50.224076 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7afdd2d1-9c99-45e5-b1e9-9fb7e50cb4d5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:50.224465 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7afdd2d1-9c99-45e5-b1e9-9fb7e50cb4d5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:50.390790 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7afdd2d1-9c99-45e5-b1e9-9fb7e50cb4d5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:50.398536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7afdd2d1-9c99-45e5-b1e9-9fb7e50cb4d5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1363 microversion: 2.1 time: 0.191316 Sep 15 19:32:50.399232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 491/760] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:50 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:51.192806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b95b4245-5219-4896-aba7-bb016c743132 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:51.195799 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b95b4245-5219-4896-aba7-bb016c743132 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:51.199831 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b95b4245-5219-4896-aba7-bb016c743132 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:51.200349 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b95b4245-5219-4896-aba7-bb016c743132 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:51.200838 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b95b4245-5219-4896-aba7-bb016c743132 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:51.201542 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b95b4245-5219-4896-aba7-bb016c743132 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:51.201997 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b95b4245-5219-4896-aba7-bb016c743132 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:51.202424 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b95b4245-5219-4896-aba7-bb016c743132 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:51.343501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b95b4245-5219-4896-aba7-bb016c743132 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:51.351438 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b95b4245-5219-4896-aba7-bb016c743132 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1259 microversion: 2.1 time: 0.167232 Sep 15 19:32:51.352052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 492/761] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:51 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:51.422121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7ffa45a5-b4ba-48e3-9216-2abf969c8535 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:51.422781 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7ffa45a5-b4ba-48e3-9216-2abf969c8535 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:51.429007 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ffa45a5-b4ba-48e3-9216-2abf969c8535 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:51.429492 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ffa45a5-b4ba-48e3-9216-2abf969c8535 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:51.429929 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ffa45a5-b4ba-48e3-9216-2abf969c8535 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:51.430663 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ffa45a5-b4ba-48e3-9216-2abf969c8535 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:51.431118 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ffa45a5-b4ba-48e3-9216-2abf969c8535 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:51.431575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ffa45a5-b4ba-48e3-9216-2abf969c8535 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:51.695771 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7ffa45a5-b4ba-48e3-9216-2abf969c8535 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:51.700961 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7ffa45a5-b4ba-48e3-9216-2abf969c8535 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1363 microversion: 2.1 time: 0.282784 Sep 15 19:32:51.701543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 493/762] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:51 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:52.378355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bf79a9ff-c841-407e-a517-edb86009b8a3 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:52.380088 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bf79a9ff-c841-407e-a517-edb86009b8a3 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:52.391280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf79a9ff-c841-407e-a517-edb86009b8a3 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:52.391800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf79a9ff-c841-407e-a517-edb86009b8a3 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:52.392424 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf79a9ff-c841-407e-a517-edb86009b8a3 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:52.393378 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf79a9ff-c841-407e-a517-edb86009b8a3 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:52.394132 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf79a9ff-c841-407e-a517-edb86009b8a3 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:52.394763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf79a9ff-c841-407e-a517-edb86009b8a3 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:52.586113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bf79a9ff-c841-407e-a517-edb86009b8a3 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:52.598508 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bf79a9ff-c841-407e-a517-edb86009b8a3 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1259 microversion: 2.1 time: 0.226792 Sep 15 19:32:52.600427 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 494/763] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:52 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:52.724068 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-360238e8-d6c8-45ad-94fb-e2cd28aae189 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:52.724817 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-360238e8-d6c8-45ad-94fb-e2cd28aae189 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:52.731808 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-360238e8-d6c8-45ad-94fb-e2cd28aae189 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:52.732332 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-360238e8-d6c8-45ad-94fb-e2cd28aae189 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:52.732841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-360238e8-d6c8-45ad-94fb-e2cd28aae189 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:52.733802 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-360238e8-d6c8-45ad-94fb-e2cd28aae189 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:52.734455 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-360238e8-d6c8-45ad-94fb-e2cd28aae189 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:52.735071 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-360238e8-d6c8-45ad-94fb-e2cd28aae189 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:52.899131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-360238e8-d6c8-45ad-94fb-e2cd28aae189 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:52.916182 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-360238e8-d6c8-45ad-94fb-e2cd28aae189 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1363 microversion: 2.1 time: 0.194205 Sep 15 19:32:52.916182 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 495/764] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:52 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:53.622557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-409b9fc0-277a-4ce8-9b4d-7f270f2f357d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:53.623245 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-409b9fc0-277a-4ce8-9b4d-7f270f2f357d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:53.630354 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-409b9fc0-277a-4ce8-9b4d-7f270f2f357d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:53.630840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-409b9fc0-277a-4ce8-9b4d-7f270f2f357d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:53.631279 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-409b9fc0-277a-4ce8-9b4d-7f270f2f357d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:53.632000 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-409b9fc0-277a-4ce8-9b4d-7f270f2f357d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:53.632456 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-409b9fc0-277a-4ce8-9b4d-7f270f2f357d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:53.632878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-409b9fc0-277a-4ce8-9b4d-7f270f2f357d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:53.786638 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-409b9fc0-277a-4ce8-9b4d-7f270f2f357d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:53.796172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-409b9fc0-277a-4ce8-9b4d-7f270f2f357d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1259 microversion: 2.1 time: 0.177548 Sep 15 19:32:53.797195 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 496/765] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:53 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:53.947146 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0d8eb839-2ab7-4285-989d-8044c009f10d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:53.947815 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0d8eb839-2ab7-4285-989d-8044c009f10d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:53.955627 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d8eb839-2ab7-4285-989d-8044c009f10d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:53.956335 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d8eb839-2ab7-4285-989d-8044c009f10d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:53.956993 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d8eb839-2ab7-4285-989d-8044c009f10d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:53.957886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d8eb839-2ab7-4285-989d-8044c009f10d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:53.958421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d8eb839-2ab7-4285-989d-8044c009f10d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:53.959016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d8eb839-2ab7-4285-989d-8044c009f10d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:54.116852 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0d8eb839-2ab7-4285-989d-8044c009f10d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:54.126352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0d8eb839-2ab7-4285-989d-8044c009f10d tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1363 microversion: 2.1 time: 0.188434 Sep 15 19:32:54.126926 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 497/766] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:53 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:54.819593 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a0cfb67f-b803-426b-a180-51b035c09dc6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:54.820283 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a0cfb67f-b803-426b-a180-51b035c09dc6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:54.826964 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0cfb67f-b803-426b-a180-51b035c09dc6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:54.827439 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0cfb67f-b803-426b-a180-51b035c09dc6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:54.827912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0cfb67f-b803-426b-a180-51b035c09dc6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:54.829201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0cfb67f-b803-426b-a180-51b035c09dc6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:54.829640 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0cfb67f-b803-426b-a180-51b035c09dc6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:54.830057 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0cfb67f-b803-426b-a180-51b035c09dc6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:54.834084 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:54.976800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a0cfb67f-b803-426b-a180-51b035c09dc6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:54.984354 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a0cfb67f-b803-426b-a180-51b035c09dc6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1259 microversion: 2.1 time: 0.168770 Sep 15 19:32:54.984927 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 498/767] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:54 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:55.149594 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1da6022f-ec40-47fb-ba30-3c73615a6774 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:55.150213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1da6022f-ec40-47fb-ba30-3c73615a6774 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:55.156579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1da6022f-ec40-47fb-ba30-3c73615a6774 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:55.157061 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1da6022f-ec40-47fb-ba30-3c73615a6774 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:55.157498 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1da6022f-ec40-47fb-ba30-3c73615a6774 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:55.158182 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1da6022f-ec40-47fb-ba30-3c73615a6774 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:55.158629 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1da6022f-ec40-47fb-ba30-3c73615a6774 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:55.159077 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1da6022f-ec40-47fb-ba30-3c73615a6774 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:55.295520 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1da6022f-ec40-47fb-ba30-3c73615a6774 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:55.303642 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1da6022f-ec40-47fb-ba30-3c73615a6774 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1363 microversion: 2.1 time: 0.158252 Sep 15 19:32:55.304235 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 499/768] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:55 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:55.308762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-cbed5fe6-e431-4302-8371-8b8294067825 req-7f748d37-b186-4377-bf7e-58289accdbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1a7eec-51a4-496a-a361-cb2e7f0b6f65", "name": "network-vif-plugged", "status": "completed", "tag": "5d9355ed-482e-4597-88f4-9572e304ef13"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:55.318912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-cbed5fe6-e431-4302-8371-8b8294067825 req-7f748d37-b186-4377-bf7e-58289accdbd7 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:55.319502 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-cbed5fe6-e431-4302-8371-8b8294067825 req-7f748d37-b186-4377-bf7e-58289accdbd7 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:55.319924 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-cbed5fe6-e431-4302-8371-8b8294067825 req-7f748d37-b186-4377-bf7e-58289accdbd7 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:55.332441 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-cbed5fe6-e431-4302-8371-8b8294067825 req-7f748d37-b186-4377-bf7e-58289accdbd7 service nova] Creating event network-vif-plugged:5d9355ed-482e-4597-88f4-9572e304ef13 for instance eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 on hv-cinder-84984 Sep 15 19:32:55.339330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-cbed5fe6-e431-4302-8371-8b8294067825 req-7f748d37-b186-4377-bf7e-58289accdbd7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033510 Sep 15 19:32:55.352846 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 500/769] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:56.008817 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ba35e557-053e-47d5-9b94-aca8424fd309 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:56.009519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ba35e557-053e-47d5-9b94-aca8424fd309 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:56.016727 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba35e557-053e-47d5-9b94-aca8424fd309 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:56.021333 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba35e557-053e-47d5-9b94-aca8424fd309 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:56.021814 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba35e557-053e-47d5-9b94-aca8424fd309 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:56.022509 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba35e557-053e-47d5-9b94-aca8424fd309 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:56.022957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba35e557-053e-47d5-9b94-aca8424fd309 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:56.023374 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba35e557-053e-47d5-9b94-aca8424fd309 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:56.177570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ba35e557-053e-47d5-9b94-aca8424fd309 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:56.186363 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ba35e557-053e-47d5-9b94-aca8424fd309 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1259 microversion: 2.1 time: 0.182477 Sep 15 19:32:56.187063 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 501/770] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:56 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:56.328059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-81962a31-39eb-42ec-9b3d-b5accbe93e6b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:56.328810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-81962a31-39eb-42ec-9b3d-b5accbe93e6b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:56.334775 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-81962a31-39eb-42ec-9b3d-b5accbe93e6b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:56.335256 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-81962a31-39eb-42ec-9b3d-b5accbe93e6b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:56.335716 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-81962a31-39eb-42ec-9b3d-b5accbe93e6b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:56.336996 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-81962a31-39eb-42ec-9b3d-b5accbe93e6b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:56.337447 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-81962a31-39eb-42ec-9b3d-b5accbe93e6b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:56.338039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-81962a31-39eb-42ec-9b3d-b5accbe93e6b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:56.620447 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-81962a31-39eb-42ec-9b3d-b5accbe93e6b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:56.628446 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-81962a31-39eb-42ec-9b3d-b5accbe93e6b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1363 microversion: 2.1 time: 0.304334 Sep 15 19:32:56.629027 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 502/771] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:56 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:57.211544 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b7cf162c-98f4-455b-b1a5-f30acd36b5a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:57.212225 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b7cf162c-98f4-455b-b1a5-f30acd36b5a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:57.219113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7cf162c-98f4-455b-b1a5-f30acd36b5a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:57.220324 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7cf162c-98f4-455b-b1a5-f30acd36b5a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:57.220760 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7cf162c-98f4-455b-b1a5-f30acd36b5a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:57.221456 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7cf162c-98f4-455b-b1a5-f30acd36b5a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:57.222081 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7cf162c-98f4-455b-b1a5-f30acd36b5a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:57.222877 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7cf162c-98f4-455b-b1a5-f30acd36b5a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:57.378130 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b7cf162c-98f4-455b-b1a5-f30acd36b5a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:57.387053 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b7cf162c-98f4-455b-b1a5-f30acd36b5a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1259 microversion: 2.1 time: 0.180099 Sep 15 19:32:57.387621 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 503/772] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:57 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:57.394033 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-61ec3bcd-50d3-4eb4-b3ef-b9b0056b136a req-1401ed02-0951-4094-898d-ee8196967bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0bedbd2-0142-4af2-a367-257352a283a5", "name": "network-vif-plugged", "status": "completed", "tag": "bd84b30a-cc10-459e-ab2e-bf61f225c610"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:32:57.403557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-61ec3bcd-50d3-4eb4-b3ef-b9b0056b136a req-1401ed02-0951-4094-898d-ee8196967bc0 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:57.404293 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-61ec3bcd-50d3-4eb4-b3ef-b9b0056b136a req-1401ed02-0951-4094-898d-ee8196967bc0 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:57.404863 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-61ec3bcd-50d3-4eb4-b3ef-b9b0056b136a req-1401ed02-0951-4094-898d-ee8196967bc0 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:57.417183 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-61ec3bcd-50d3-4eb4-b3ef-b9b0056b136a req-1401ed02-0951-4094-898d-ee8196967bc0 service nova] Creating event network-vif-plugged:bd84b30a-cc10-459e-ab2e-bf61f225c610 for instance d0bedbd2-0142-4af2-a367-257352a283a5 on hv-cinder-84984 Sep 15 19:32:57.422698 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-61ec3bcd-50d3-4eb4-b3ef-b9b0056b136a req-1401ed02-0951-4094-898d-ee8196967bc0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033670 Sep 15 19:32:57.423839 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 504/773] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:32:57.655476 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d5d76b3b-6a96-41c2-9683-a550960e4e23 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:57.656621 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d5d76b3b-6a96-41c2-9683-a550960e4e23 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:57.663807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5d76b3b-6a96-41c2-9683-a550960e4e23 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:57.664317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5d76b3b-6a96-41c2-9683-a550960e4e23 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:57.664761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5d76b3b-6a96-41c2-9683-a550960e4e23 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:57.665490 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5d76b3b-6a96-41c2-9683-a550960e4e23 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:57.665950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5d76b3b-6a96-41c2-9683-a550960e4e23 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:57.666379 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5d76b3b-6a96-41c2-9683-a550960e4e23 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:57.850380 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d5d76b3b-6a96-41c2-9683-a550960e4e23 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:57.859437 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d5d76b3b-6a96-41c2-9683-a550960e4e23 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1363 microversion: 2.1 time: 0.211941 Sep 15 19:32:57.861445 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 505/774] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:57 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:58.418668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b1bf9a99-76b8-4729-b720-fbbb9e5e6e04 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:58.420200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b1bf9a99-76b8-4729-b720-fbbb9e5e6e04 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:58.433105 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b1bf9a99-76b8-4729-b720-fbbb9e5e6e04 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:58.434486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b1bf9a99-76b8-4729-b720-fbbb9e5e6e04 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:58.435699 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b1bf9a99-76b8-4729-b720-fbbb9e5e6e04 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:58.436906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b1bf9a99-76b8-4729-b720-fbbb9e5e6e04 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:58.441649 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b1bf9a99-76b8-4729-b720-fbbb9e5e6e04 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:58.442439 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b1bf9a99-76b8-4729-b720-fbbb9e5e6e04 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:58.639760 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b1bf9a99-76b8-4729-b720-fbbb9e5e6e04 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:58.648735 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b1bf9a99-76b8-4729-b720-fbbb9e5e6e04 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1443 microversion: 2.1 time: 0.240645 Sep 15 19:32:58.649539 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 506/775] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:58 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1443 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:32:58.673145 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-91a76ac6-c9a2-44b0-9a35-7cf62a491777 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:58.674572 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-91a76ac6-c9a2-44b0-9a35-7cf62a491777 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:58.681430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91a76ac6-c9a2-44b0-9a35-7cf62a491777 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:58.686048 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91a76ac6-c9a2-44b0-9a35-7cf62a491777 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:58.686048 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91a76ac6-c9a2-44b0-9a35-7cf62a491777 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:58.686048 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91a76ac6-c9a2-44b0-9a35-7cf62a491777 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:58.686048 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91a76ac6-c9a2-44b0-9a35-7cf62a491777 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:58.686404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91a76ac6-c9a2-44b0-9a35-7cf62a491777 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:58.859748 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-91a76ac6-c9a2-44b0-9a35-7cf62a491777 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:58.869753 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-91a76ac6-c9a2-44b0-9a35-7cf62a491777 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1443 microversion: 2.1 time: 0.200938 Sep 15 19:32:58.887789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 507/776] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:58 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1443 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:32:58.901835 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-57b9dfa8-b27e-4b2e-9914-e18f857f6ac5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:32:58.902323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-57b9dfa8-b27e-4b2e-9914-e18f857f6ac5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:32:58.915943 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57b9dfa8-b27e-4b2e-9914-e18f857f6ac5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:58.916752 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57b9dfa8-b27e-4b2e-9914-e18f857f6ac5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:58.917259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57b9dfa8-b27e-4b2e-9914-e18f857f6ac5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:58.918022 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57b9dfa8-b27e-4b2e-9914-e18f857f6ac5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:32:58.918819 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57b9dfa8-b27e-4b2e-9914-e18f857f6ac5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:32:58.919562 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57b9dfa8-b27e-4b2e-9914-e18f857f6ac5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:32:59.262092 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-57b9dfa8-b27e-4b2e-9914-e18f857f6ac5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:32:59.280445 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-57b9dfa8-b27e-4b2e-9914-e18f857f6ac5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1363 microversion: 2.1 time: 0.389944 Sep 15 19:32:59.281521 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 508/777] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:32:58 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1363 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:33:00.305015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-69adde0f-d6e9-4742-b7b1-d35ca734de34 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:00.305925 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-69adde0f-d6e9-4742-b7b1-d35ca734de34 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:00.319502 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69adde0f-d6e9-4742-b7b1-d35ca734de34 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:00.320260 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69adde0f-d6e9-4742-b7b1-d35ca734de34 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:00.321333 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69adde0f-d6e9-4742-b7b1-d35ca734de34 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:00.322369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69adde0f-d6e9-4742-b7b1-d35ca734de34 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:00.323046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69adde0f-d6e9-4742-b7b1-d35ca734de34 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:00.324024 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69adde0f-d6e9-4742-b7b1-d35ca734de34 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:00.583498 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-69adde0f-d6e9-4742-b7b1-d35ca734de34 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:00.596169 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-69adde0f-d6e9-4742-b7b1-d35ca734de34 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1549 microversion: 2.1 time: 0.295851 Sep 15 19:33:00.599168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 509/778] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:00 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1549 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:33:00.627335 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3090a409-e431-4fa1-acee-299d2de57371 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:00.628291 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3090a409-e431-4fa1-acee-299d2de57371 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:00.637091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3090a409-e431-4fa1-acee-299d2de57371 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:00.641778 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3090a409-e431-4fa1-acee-299d2de57371 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:00.642242 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3090a409-e431-4fa1-acee-299d2de57371 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:00.642994 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3090a409-e431-4fa1-acee-299d2de57371 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:00.643454 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3090a409-e431-4fa1-acee-299d2de57371 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:00.643917 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3090a409-e431-4fa1-acee-299d2de57371 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:00.758810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3090a409-e431-4fa1-acee-299d2de57371 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136616 Sep 15 19:33:00.759877 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 510/779] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 15 19:33:00 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:33:01.945596 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-58e3b4bd-d6fb-4a88-bcbd-93560ffa58ba tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Action: 'create', calling method: .version_select at 0x7f551ea01550>, body: {"keypair": {"name": "tempest-keypair-1643718889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTYGiHTazqSt+fPjjhyi9hA8JKcp4XMMn2UVbD5huYRYm4GaCRzv4Bu/EbC/bXBanNouEmuHk2XYBvl4dq85TT4HE0bBpeFwGvLDrtz5SmR2lqXc8tuK+0Gno1y6ugTCw=="}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:33:01.978139 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-58e3b4bd-d6fb-4a88-bcbd-93560ffa58ba tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Getting quotas for project 427b697da1034408811e994e22d4f592. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:33:01.983513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-58e3b4bd-d6fb-4a88-bcbd-93560ffa58ba tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Getting quotas for user 250673e17f40455ca2c5e0036f5a9e3c and project 427b697da1034408811e994e22d4f592. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:33:02.121289 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-58e3b4bd-d6fb-4a88-bcbd-93560ffa58ba tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.343428 Sep 15 19:33:02.121668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 511/780] 10.222.0.18 () {62 vars in 1200 bytes} [Thu Sep 15 19:33:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 345 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 15 19:33:02.400021 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-45e6dc63-d156-4fde-b490-5e5307b5ad04 req-972b460c-b168-4ea3-9f7c-163569965f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb1a7eec-51a4-496a-a361-cb2e7f0b6f65", "tag": "5d9355ed-482e-4597-88f4-9572e304ef13"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:33:02.415430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-45e6dc63-d156-4fde-b490-5e5307b5ad04 req-972b460c-b168-4ea3-9f7c-163569965f02 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:02.416591 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-45e6dc63-d156-4fde-b490-5e5307b5ad04 req-972b460c-b168-4ea3-9f7c-163569965f02 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:02.417242 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-45e6dc63-d156-4fde-b490-5e5307b5ad04 req-972b460c-b168-4ea3-9f7c-163569965f02 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:02.430551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-45e6dc63-d156-4fde-b490-5e5307b5ad04 req-972b460c-b168-4ea3-9f7c-163569965f02 service nova] Creating event network-changed:5d9355ed-482e-4597-88f4-9572e304ef13 for instance eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 on hv-cinder-84984 Sep 15 19:33:02.440307 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-45e6dc63-d156-4fde-b490-5e5307b5ad04 req-972b460c-b168-4ea3-9f7c-163569965f02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046091 Sep 15 19:33:02.442107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 512/781] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:33:04.467780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-e98c1904-6d14-4632-8b2a-b15b53e2a5ce req-84e0812b-a558-4a1a-a905-b59855de324a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0bedbd2-0142-4af2-a367-257352a283a5", "tag": "bd84b30a-cc10-459e-ab2e-bf61f225c610"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:33:04.485899 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e98c1904-6d14-4632-8b2a-b15b53e2a5ce req-84e0812b-a558-4a1a-a905-b59855de324a service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:04.487295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e98c1904-6d14-4632-8b2a-b15b53e2a5ce req-84e0812b-a558-4a1a-a905-b59855de324a service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:04.487295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e98c1904-6d14-4632-8b2a-b15b53e2a5ce req-84e0812b-a558-4a1a-a905-b59855de324a service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:04.499557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-e98c1904-6d14-4632-8b2a-b15b53e2a5ce req-84e0812b-a558-4a1a-a905-b59855de324a service nova] Creating event network-changed:bd84b30a-cc10-459e-ab2e-bf61f225c610 for instance d0bedbd2-0142-4af2-a367-257352a283a5 on hv-cinder-84984 Sep 15 19:33:04.505662 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-e98c1904-6d14-4632-8b2a-b15b53e2a5ce req-84e0812b-a558-4a1a-a905-b59855de324a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043269 Sep 15 19:33:04.507794 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 513/782] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:33:05.236576 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-924118379", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fec50405-c88e-450d-9ebf-156c556a1bf0"}], "security_groups": [{"name": "tempest-securitygroup--1973748773"}], "key_name": "tempest-keypair-1643718889", "user_data": "}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:33:05.379798 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] validate_networks() for [('fec50405-c88e-450d-9ebf-156c556a1bf0', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:33:05.814916 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:33:05.815500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:33:05.815875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:33:05.816638 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:33:05.817064 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:33:05.829356 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:05.830109 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:05.830545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:05.831353 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:05.831845 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:05.832263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:05.855703 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Getting quotas for project 427b697da1034408811e994e22d4f592. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:33:05.859444 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:33:05.861435 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Getting quotas for user 250673e17f40455ca2c5e0036f5a9e3c and project 427b697da1034408811e994e22d4f592. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:33:05.877478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:33:05.877478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:33:06.066065 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1b8bc9e3-77c5-4108-9881-2506abbc6fd5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.834412 Sep 15 19:33:06.074161 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 514/783] 10.222.0.18 () {62 vars in 1188 bytes} [Thu Sep 15 19:33:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 15 19:33:06.083468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-694bdb24-abf3-4aa2-8339-b4cc7fdcf818 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:06.085414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-694bdb24-abf3-4aa2-8339-b4cc7fdcf818 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:06.155381 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-694bdb24-abf3-4aa2-8339-b4cc7fdcf818 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:06.162681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-694bdb24-abf3-4aa2-8339-b4cc7fdcf818 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:06.164196 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-694bdb24-abf3-4aa2-8339-b4cc7fdcf818 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:06.165317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-694bdb24-abf3-4aa2-8339-b4cc7fdcf818 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1281 microversion: 2.20 time: 0.089470 Sep 15 19:33:06.165870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 515/784] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:33:06 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:33:07.190685 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c0f411cd-5f58-474f-9a6e-dbd0a1858659 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:07.191346 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c0f411cd-5f58-474f-9a6e-dbd0a1858659 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:07.198195 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0f411cd-5f58-474f-9a6e-dbd0a1858659 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:07.198687 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0f411cd-5f58-474f-9a6e-dbd0a1858659 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:07.199125 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0f411cd-5f58-474f-9a6e-dbd0a1858659 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:07.199878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0f411cd-5f58-474f-9a6e-dbd0a1858659 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:07.200331 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0f411cd-5f58-474f-9a6e-dbd0a1858659 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:07.200784 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0f411cd-5f58-474f-9a6e-dbd0a1858659 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:07.261891 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c0f411cd-5f58-474f-9a6e-dbd0a1858659 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:07.270626 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c0f411cd-5f58-474f-9a6e-dbd0a1858659 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:07.272105 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c0f411cd-5f58-474f-9a6e-dbd0a1858659 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:07.273199 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c0f411cd-5f58-474f-9a6e-dbd0a1858659 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1285 microversion: 2.20 time: 0.087471 Sep 15 19:33:07.273750 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 516/785] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:33:07 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:33:08.298250 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a449b251-4ef9-4d4a-bd22-baea8748b8b4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:08.298944 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a449b251-4ef9-4d4a-bd22-baea8748b8b4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:08.305376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a449b251-4ef9-4d4a-bd22-baea8748b8b4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:08.305856 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a449b251-4ef9-4d4a-bd22-baea8748b8b4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:08.306291 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a449b251-4ef9-4d4a-bd22-baea8748b8b4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:08.306987 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a449b251-4ef9-4d4a-bd22-baea8748b8b4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:08.307436 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a449b251-4ef9-4d4a-bd22-baea8748b8b4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:08.308047 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a449b251-4ef9-4d4a-bd22-baea8748b8b4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:08.372080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a449b251-4ef9-4d4a-bd22-baea8748b8b4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:08.380333 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a449b251-4ef9-4d4a-bd22-baea8748b8b4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:08.381794 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a449b251-4ef9-4d4a-bd22-baea8748b8b4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:08.383002 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a449b251-4ef9-4d4a-bd22-baea8748b8b4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1333 microversion: 2.20 time: 0.088712 Sep 15 19:33:08.383565 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 517/786] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:33:08 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:33:09.410151 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c0188bfd-95f8-4132-8601-56e5b34d3593 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:09.410882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c0188bfd-95f8-4132-8601-56e5b34d3593 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:09.417947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0188bfd-95f8-4132-8601-56e5b34d3593 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:09.418437 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0188bfd-95f8-4132-8601-56e5b34d3593 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:09.418875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0188bfd-95f8-4132-8601-56e5b34d3593 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:09.419579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0188bfd-95f8-4132-8601-56e5b34d3593 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:09.420065 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0188bfd-95f8-4132-8601-56e5b34d3593 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:09.420488 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c0188bfd-95f8-4132-8601-56e5b34d3593 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:09.500122 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c0188bfd-95f8-4132-8601-56e5b34d3593 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:09.508546 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c0188bfd-95f8-4132-8601-56e5b34d3593 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:09.509992 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c0188bfd-95f8-4132-8601-56e5b34d3593 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:09.511076 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c0188bfd-95f8-4132-8601-56e5b34d3593 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1339 microversion: 2.20 time: 0.105832 Sep 15 19:33:09.511629 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 518/787] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:33:09 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:33:10.536864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-129dc350-7c4e-4936-b3bc-498f92387fca tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:10.537558 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-129dc350-7c4e-4936-b3bc-498f92387fca tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:10.544750 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-129dc350-7c4e-4936-b3bc-498f92387fca tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:10.545342 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-129dc350-7c4e-4936-b3bc-498f92387fca tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:10.546198 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-129dc350-7c4e-4936-b3bc-498f92387fca tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:10.546692 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-129dc350-7c4e-4936-b3bc-498f92387fca tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:10.547797 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-129dc350-7c4e-4936-b3bc-498f92387fca tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:10.548509 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-129dc350-7c4e-4936-b3bc-498f92387fca tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:10.738651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-129dc350-7c4e-4936-b3bc-498f92387fca tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:10.746551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-129dc350-7c4e-4936-b3bc-498f92387fca tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:10.748009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-129dc350-7c4e-4936-b3bc-498f92387fca tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:10.749099 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-129dc350-7c4e-4936-b3bc-498f92387fca tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1407 microversion: 2.20 time: 0.216154 Sep 15 19:33:10.749648 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 519/788] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:33:10 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:33:10.825845 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-99cdf22e-61ad-4f1a-97f4-78f0a379905a req-51910810-7ab3-41b4-9597-3cdf17c7461f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4", "tag": "143ce322-19a2-43c5-83ec-ba67ce8ce7cc"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:33:10.835910 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-99cdf22e-61ad-4f1a-97f4-78f0a379905a req-51910810-7ab3-41b4-9597-3cdf17c7461f service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:10.836436 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-99cdf22e-61ad-4f1a-97f4-78f0a379905a req-51910810-7ab3-41b4-9597-3cdf17c7461f service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:10.836859 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-99cdf22e-61ad-4f1a-97f4-78f0a379905a req-51910810-7ab3-41b4-9597-3cdf17c7461f service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:10.848787 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-99cdf22e-61ad-4f1a-97f4-78f0a379905a req-51910810-7ab3-41b4-9597-3cdf17c7461f service nova] Creating event network-changed:143ce322-19a2-43c5-83ec-ba67ce8ce7cc for instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 on hv-cinder-84984 Sep 15 19:33:10.854154 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-99cdf22e-61ad-4f1a-97f4-78f0a379905a req-51910810-7ab3-41b4-9597-3cdf17c7461f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031949 Sep 15 19:33:10.854742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 520/789] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:33:11.774135 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cea1ee6d-8c3a-45dc-9b42-aca8d71e1a5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:11.774939 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cea1ee6d-8c3a-45dc-9b42-aca8d71e1a5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:11.781973 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cea1ee6d-8c3a-45dc-9b42-aca8d71e1a5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:11.782463 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cea1ee6d-8c3a-45dc-9b42-aca8d71e1a5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:11.782973 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cea1ee6d-8c3a-45dc-9b42-aca8d71e1a5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:11.783707 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cea1ee6d-8c3a-45dc-9b42-aca8d71e1a5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:11.784168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cea1ee6d-8c3a-45dc-9b42-aca8d71e1a5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:11.784594 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cea1ee6d-8c3a-45dc-9b42-aca8d71e1a5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:11.788834 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:33:11.932248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cea1ee6d-8c3a-45dc-9b42-aca8d71e1a5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:11.941278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cea1ee6d-8c3a-45dc-9b42-aca8d71e1a5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:11.943113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cea1ee6d-8c3a-45dc-9b42-aca8d71e1a5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:11.943915 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cea1ee6d-8c3a-45dc-9b42-aca8d71e1a5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1407 microversion: 2.20 time: 0.174148 Sep 15 19:33:11.944470 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 521/790] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:33:11 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:33:12.404748 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8743655f-bac6-4b82-9b3e-155831f1d38b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:12.405235 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8743655f-bac6-4b82-9b3e-155831f1d38b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:12.411931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8743655f-bac6-4b82-9b3e-155831f1d38b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:12.412416 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8743655f-bac6-4b82-9b3e-155831f1d38b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:12.412846 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8743655f-bac6-4b82-9b3e-155831f1d38b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:12.413531 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8743655f-bac6-4b82-9b3e-155831f1d38b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:12.413977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8743655f-bac6-4b82-9b3e-155831f1d38b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:12.414405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8743655f-bac6-4b82-9b3e-155831f1d38b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:12.501034 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-8743655f-bac6-4b82-9b3e-155831f1d38b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lazy-loading 'services' on Instance uuid 756ade48-671d-4ee9-84cd-f7b0e0f07712 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:33:12.738864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8743655f-bac6-4b82-9b3e-155831f1d38b tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "DELETE /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712/os-volume_attachments/25628d44-abc9-4c10-8e85-2e88a0ce7b46" status: 202 len: 0 microversion: 2.1 time: 0.337837 Sep 15 19:33:12.739471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 522/791] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 15 19:33:12 2022] DELETE /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712/os-volume_attachments/25628d44-abc9-4c10-8e85-2e88a0ce7b46 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 19:33:12.970419 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a9d2e39c-172d-478e-aeb1-85865e2f4a8c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:12.971118 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a9d2e39c-172d-478e-aeb1-85865e2f4a8c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:12.977374 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a9d2e39c-172d-478e-aeb1-85865e2f4a8c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:12.977856 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a9d2e39c-172d-478e-aeb1-85865e2f4a8c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:12.978289 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a9d2e39c-172d-478e-aeb1-85865e2f4a8c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:12.979033 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a9d2e39c-172d-478e-aeb1-85865e2f4a8c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:12.979493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a9d2e39c-172d-478e-aeb1-85865e2f4a8c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:12.979961 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a9d2e39c-172d-478e-aeb1-85865e2f4a8c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:13.114570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a9d2e39c-172d-478e-aeb1-85865e2f4a8c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:13.122589 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a9d2e39c-172d-478e-aeb1-85865e2f4a8c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:13.124059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a9d2e39c-172d-478e-aeb1-85865e2f4a8c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:13.125649 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a9d2e39c-172d-478e-aeb1-85865e2f4a8c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1407 microversion: 2.20 time: 0.160301 Sep 15 19:33:13.126202 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 523/792] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:33:12 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:33:13.863934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-da8a3df4-f346-4f18-8786-72fcaed845b6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:13.864440 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-da8a3df4-f346-4f18-8786-72fcaed845b6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:13.870682 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da8a3df4-f346-4f18-8786-72fcaed845b6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:13.871166 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da8a3df4-f346-4f18-8786-72fcaed845b6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:13.871611 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da8a3df4-f346-4f18-8786-72fcaed845b6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:13.872361 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da8a3df4-f346-4f18-8786-72fcaed845b6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:13.872813 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da8a3df4-f346-4f18-8786-72fcaed845b6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:13.873239 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da8a3df4-f346-4f18-8786-72fcaed845b6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:13.898262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-da8a3df4-f346-4f18-8786-72fcaed845b6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:33:14.178774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-da8a3df4-f346-4f18-8786-72fcaed845b6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "DELETE /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 204 len: 0 microversion: 2.1 time: 0.319731 Sep 15 19:33:14.179487 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 524/793] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:33:13 2022] DELETE /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 19:33:14.184492 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e7426767-0799-4528-9b76-a63ae895ce1e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:14.185192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e7426767-0799-4528-9b76-a63ae895ce1e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:14.191386 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7426767-0799-4528-9b76-a63ae895ce1e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:14.191910 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7426767-0799-4528-9b76-a63ae895ce1e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:14.192355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7426767-0799-4528-9b76-a63ae895ce1e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:14.193053 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7426767-0799-4528-9b76-a63ae895ce1e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:14.193508 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7426767-0799-4528-9b76-a63ae895ce1e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:14.193979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7426767-0799-4528-9b76-a63ae895ce1e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:14.326248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e7426767-0799-4528-9b76-a63ae895ce1e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:14.335348 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e7426767-0799-4528-9b76-a63ae895ce1e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:14.336979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e7426767-0799-4528-9b76-a63ae895ce1e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:14.338134 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e7426767-0799-4528-9b76-a63ae895ce1e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1407 microversion: 2.20 time: 0.157582 Sep 15 19:33:14.338697 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 525/794] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:33:14 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:33:14.343244 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2c6cc0f5-d739-4b83-9ca6-5c8339c13e89 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:14.344613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2c6cc0f5-d739-4b83-9ca6-5c8339c13e89 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:14.350486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2c6cc0f5-d739-4b83-9ca6-5c8339c13e89 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:14.351014 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2c6cc0f5-d739-4b83-9ca6-5c8339c13e89 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:14.351456 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2c6cc0f5-d739-4b83-9ca6-5c8339c13e89 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:14.352177 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2c6cc0f5-d739-4b83-9ca6-5c8339c13e89 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:14.352636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2c6cc0f5-d739-4b83-9ca6-5c8339c13e89 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:14.353102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2c6cc0f5-d739-4b83-9ca6-5c8339c13e89 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:14.484682 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2c6cc0f5-d739-4b83-9ca6-5c8339c13e89 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:14.492737 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2c6cc0f5-d739-4b83-9ca6-5c8339c13e89 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1513 microversion: 2.1 time: 0.153040 Sep 15 19:33:14.493524 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 526/795] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:14 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:33:15.364335 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-11fcd4af-fb52-44c6-86d1-7e69cd8a96f2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:15.365011 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-11fcd4af-fb52-44c6-86d1-7e69cd8a96f2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:15.371411 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-11fcd4af-fb52-44c6-86d1-7e69cd8a96f2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:15.371928 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-11fcd4af-fb52-44c6-86d1-7e69cd8a96f2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:15.372363 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-11fcd4af-fb52-44c6-86d1-7e69cd8a96f2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:15.373058 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-11fcd4af-fb52-44c6-86d1-7e69cd8a96f2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:15.373510 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-11fcd4af-fb52-44c6-86d1-7e69cd8a96f2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:15.373935 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-11fcd4af-fb52-44c6-86d1-7e69cd8a96f2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:15.503399 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-11fcd4af-fb52-44c6-86d1-7e69cd8a96f2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:15.511609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-11fcd4af-fb52-44c6-86d1-7e69cd8a96f2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:15.513075 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-11fcd4af-fb52-44c6-86d1-7e69cd8a96f2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:15.514175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-11fcd4af-fb52-44c6-86d1-7e69cd8a96f2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1407 microversion: 2.20 time: 0.154392 Sep 15 19:33:15.514888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 527/796] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:33:15 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:33:15.519764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-29647f03-eec8-433d-acd5-bf76c4bc4c71 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:15.520361 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-29647f03-eec8-433d-acd5-bf76c4bc4c71 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:15.526150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29647f03-eec8-433d-acd5-bf76c4bc4c71 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:15.526629 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29647f03-eec8-433d-acd5-bf76c4bc4c71 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:15.527057 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29647f03-eec8-433d-acd5-bf76c4bc4c71 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:15.527757 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29647f03-eec8-433d-acd5-bf76c4bc4c71 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:15.528204 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29647f03-eec8-433d-acd5-bf76c4bc4c71 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:15.528618 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29647f03-eec8-433d-acd5-bf76c4bc4c71 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:15.845192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:33:15.910863 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-29647f03-eec8-433d-acd5-bf76c4bc4c71 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:15.918584 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-29647f03-eec8-433d-acd5-bf76c4bc4c71 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1513 microversion: 2.1 time: 0.402420 Sep 15 19:33:15.919156 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 528/797] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:15 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1513 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:33:16.538712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5978a6ec-1d7d-438a-b1ca-f819d46b9ba1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:16.539666 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5978a6ec-1d7d-438a-b1ca-f819d46b9ba1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:16.541514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=12 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:33:16.546716 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5978a6ec-1d7d-438a-b1ca-f819d46b9ba1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:16.547990 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5978a6ec-1d7d-438a-b1ca-f819d46b9ba1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:16.548723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5978a6ec-1d7d-438a-b1ca-f819d46b9ba1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:16.549439 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5978a6ec-1d7d-438a-b1ca-f819d46b9ba1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:16.549902 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5978a6ec-1d7d-438a-b1ca-f819d46b9ba1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:16.550323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5978a6ec-1d7d-438a-b1ca-f819d46b9ba1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:16.682881 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5978a6ec-1d7d-438a-b1ca-f819d46b9ba1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:16.692342 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5978a6ec-1d7d-438a-b1ca-f819d46b9ba1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:16.693784 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5978a6ec-1d7d-438a-b1ca-f819d46b9ba1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:16.694897 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5978a6ec-1d7d-438a-b1ca-f819d46b9ba1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1407 microversion: 2.20 time: 0.160140 Sep 15 19:33:16.695450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 529/798] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:33:16 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:33:16.785013 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-05690927-66d0-438f-bce8-88eacfdcc099 req-e5501c7e-bd5e-4cdc-95b8-b78a3329c692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4", "name": "network-vif-plugged", "status": "completed", "tag": "143ce322-19a2-43c5-83ec-ba67ce8ce7cc"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:33:16.796078 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-05690927-66d0-438f-bce8-88eacfdcc099 req-e5501c7e-bd5e-4cdc-95b8-b78a3329c692 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:16.796559 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-05690927-66d0-438f-bce8-88eacfdcc099 req-e5501c7e-bd5e-4cdc-95b8-b78a3329c692 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:16.797004 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-05690927-66d0-438f-bce8-88eacfdcc099 req-e5501c7e-bd5e-4cdc-95b8-b78a3329c692 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:16.808666 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-05690927-66d0-438f-bce8-88eacfdcc099 req-e5501c7e-bd5e-4cdc-95b8-b78a3329c692 service nova] Creating event network-vif-plugged:143ce322-19a2-43c5-83ec-ba67ce8ce7cc for instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 on hv-cinder-84984 Sep 15 19:33:16.813793 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-05690927-66d0-438f-bce8-88eacfdcc099 req-e5501c7e-bd5e-4cdc-95b8-b78a3329c692 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035542 Sep 15 19:33:16.814406 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 530/799] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:33:16.819317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-0a799974-8b8b-4353-aea2-f24b4471c4ba req-f8b8843c-d11d-4428-b0c9-54a4ced07a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756ade48-671d-4ee9-84cd-f7b0e0f07712", "name": "network-vif-deleted", "tag": "495e3394-0786-4d88-a7ab-ecf29d2c4fe5"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:33:16.828895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-0a799974-8b8b-4353-aea2-f24b4471c4ba req-f8b8843c-d11d-4428-b0c9-54a4ced07a09 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:16.829366 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-0a799974-8b8b-4353-aea2-f24b4471c4ba req-f8b8843c-d11d-4428-b0c9-54a4ced07a09 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:16.830032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-0a799974-8b8b-4353-aea2-f24b4471c4ba req-f8b8843c-d11d-4428-b0c9-54a4ced07a09 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:16.841722 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-0a799974-8b8b-4353-aea2-f24b4471c4ba req-f8b8843c-d11d-4428-b0c9-54a4ced07a09 service nova] Creating event network-vif-deleted:495e3394-0786-4d88-a7ab-ecf29d2c4fe5 for instance 756ade48-671d-4ee9-84cd-f7b0e0f07712 on hv-cinder-84984 Sep 15 19:33:16.847284 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-0a799974-8b8b-4353-aea2-f24b4471c4ba req-f8b8843c-d11d-4428-b0c9-54a4ced07a09 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031604 Sep 15 19:33:16.848266 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 531/800] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:33:16.943267 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-981f134f-1839-4427-8156-5774572971d5 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:16.944012 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-981f134f-1839-4427-8156-5774572971d5 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:16.950564 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-981f134f-1839-4427-8156-5774572971d5 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:16.951052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-981f134f-1839-4427-8156-5774572971d5 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:16.951489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-981f134f-1839-4427-8156-5774572971d5 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:16.952222 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-981f134f-1839-4427-8156-5774572971d5 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:16.952679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-981f134f-1839-4427-8156-5774572971d5 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:16.953110 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-981f134f-1839-4427-8156-5774572971d5 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:17.022342 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-981f134f-1839-4427-8156-5774572971d5 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:17.030398 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-981f134f-1839-4427-8156-5774572971d5 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1471 microversion: 2.1 time: 0.092574 Sep 15 19:33:17.030978 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 532/801] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:16 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1471 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:33:17.734490 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-497a19c1-7681-41c2-9d01-b47838df2844 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:17.736281 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-497a19c1-7681-41c2-9d01-b47838df2844 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:17.742775 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-497a19c1-7681-41c2-9d01-b47838df2844 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:17.743254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-497a19c1-7681-41c2-9d01-b47838df2844 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:17.743713 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-497a19c1-7681-41c2-9d01-b47838df2844 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:17.744410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-497a19c1-7681-41c2-9d01-b47838df2844 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:17.744863 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-497a19c1-7681-41c2-9d01-b47838df2844 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:17.745286 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-497a19c1-7681-41c2-9d01-b47838df2844 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:17.881030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-497a19c1-7681-41c2-9d01-b47838df2844 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:17.890080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-497a19c1-7681-41c2-9d01-b47838df2844 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:17.891113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-497a19c1-7681-41c2-9d01-b47838df2844 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:17.892314 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-497a19c1-7681-41c2-9d01-b47838df2844 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1407 microversion: 2.20 time: 0.168851 Sep 15 19:33:17.892867 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 533/802] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:33:17 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:33:18.054819 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:18.055420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:18.062016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:18.062496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:18.062936 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:18.063691 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:18.064684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:18.065103 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:18.095485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:18.095912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:18.096344 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:18.096794 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lazy-loading 'fault' on Instance uuid 756ade48-671d-4ee9-84cd-f7b0e0f07712 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:33:18.138081 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c76463423664f649bd018d853010cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee88123fe2e34b02a00baeb6f74869aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:18.146114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5843254a-c3f2-43ec-bf27-53dc8f1b0ec8 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 200 len: 1308 microversion: 2.1 time: 0.095210 Sep 15 19:33:18.146678 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 534/803] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:18 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:33:18.917926 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dfa366aa-f921-4421-a40b-55d13855c5df tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:18.919191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-dfa366aa-f921-4421-a40b-55d13855c5df tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:18.926722 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfa366aa-f921-4421-a40b-55d13855c5df tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:18.927209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfa366aa-f921-4421-a40b-55d13855c5df tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:18.927679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfa366aa-f921-4421-a40b-55d13855c5df tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:18.928383 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfa366aa-f921-4421-a40b-55d13855c5df tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:18.928843 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfa366aa-f921-4421-a40b-55d13855c5df tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:18.929270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfa366aa-f921-4421-a40b-55d13855c5df tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:19.066616 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dfa366aa-f921-4421-a40b-55d13855c5df tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:19.074731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dfa366aa-f921-4421-a40b-55d13855c5df tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:19.076206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dfa366aa-f921-4421-a40b-55d13855c5df tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:19.077314 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dfa366aa-f921-4421-a40b-55d13855c5df tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1407 microversion: 2.20 time: 0.164566 Sep 15 19:33:19.077873 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 535/804] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:33:18 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:33:19.169364 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-eddaa9bd-7e49-4de1-9155-b11ece90cad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:19.169885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-eddaa9bd-7e49-4de1-9155-b11ece90cad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] [instance: 756ade48-671d-4ee9-84cd-f7b0e0f07712] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:19.176652 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eddaa9bd-7e49-4de1-9155-b11ece90cad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:19.177138 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eddaa9bd-7e49-4de1-9155-b11ece90cad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:19.177571 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eddaa9bd-7e49-4de1-9155-b11ece90cad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:19.178269 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eddaa9bd-7e49-4de1-9155-b11ece90cad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:19.178723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eddaa9bd-7e49-4de1-9155-b11ece90cad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:19.179146 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eddaa9bd-7e49-4de1-9155-b11ece90cad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:19.193036 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-eddaa9bd-7e49-4de1-9155-b11ece90cad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] HTTP exception thrown: Instance 756ade48-671d-4ee9-84cd-f7b0e0f07712 could not be found. Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-eddaa9bd-7e49-4de1-9155-b11ece90cad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Request method failure captured: Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 HTTP/1.1 Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI31zk1GhjObBglpaLLdxpnjrJGxoosgweb9L585hHf2evoiWm46dNRHvrDJui4Ke4OXAwFUJviTiREEPiojrfuJqTLMUz_RorTz-yeTW-ACVt3s5ybtdDUcG2RrvPvLzRkS4oz2uPzV6HKMOzJAuGEZADwe9BSFs52DwQHJcGac3oB8 Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: ee88123fe2e34b02a00baeb6f74869aa Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesSnapshotTestJSON-232021177 Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:33:19.194742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:33:19.196310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee88123fe2e34b02a00baeb6f74869aa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee88123fe2e34b02a00baeb6f74869aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee88123fe2e34b02a00baeb6f74869aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee88123fe2e34b02a00baeb6f74869aa"}]}] Sep 15 19:33:19.196310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesSnapshotTestJSON-232021177 Sep 15 19:33:19.196310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: ee88123fe2e34b02a00baeb6f74869aa Sep 15 19:33:19.196310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-232021177 Sep 15 19:33:19.196310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesSnapshotTestJSON-232021177-project Sep 15 19:33:19.196310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:33:19.196310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:33:19.196310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 8c76463423664f649bd018d853010cad Sep 15 19:33:19.196310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesSnapshotTestJSON-232021177-project Sep 15 19:33:19.196310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:33:19.196310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 756ade48-671d-4ee9-84cd-f7b0e0f07712 could not be found. Sep 15 19:33:19.196310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '756ade48-671d-4ee9-84cd-f7b0e0f07712'} Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756ade48-671d-4ee9-84cd-f7b0e0f07712 could not be found. Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:33:19.197149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756ade48-671d-4ee9-84cd-f7b0e0f07712 could not be found. Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756ade48-671d-4ee9-84cd-f7b0e0f07712 could not be found. Sep 15 19:33:19.198607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:19.202181 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-eddaa9bd-7e49-4de1-9155-b11ece90cad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] Returning 404 to user: Instance 756ade48-671d-4ee9-84cd-f7b0e0f07712 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:33:19.202181 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-eddaa9bd-7e49-4de1-9155-b11ece90cad6 tempest-VolumesSnapshotTestJSON-232021177 tempest-VolumesSnapshotTestJSON-232021177-project] 10.222.0.18 "GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712" status: 404 len: 111 microversion: 2.1 time: 0.030882 Sep 15 19:33:19.202181 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 536/805] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:19 2022] GET /compute/v2.1/servers/756ade48-671d-4ee9-84cd-f7b0e0f07712 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:33:19.768840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 19:33:19.769320 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Thu Sep 15 19:33:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Sep 15 19:33:20.102890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-51a436d5-df02-410f-ac2c-3aba1b4d11b1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:20.103609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-51a436d5-df02-410f-ac2c-3aba1b4d11b1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:20.110668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-51a436d5-df02-410f-ac2c-3aba1b4d11b1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:20.111173 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-51a436d5-df02-410f-ac2c-3aba1b4d11b1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:20.111670 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-51a436d5-df02-410f-ac2c-3aba1b4d11b1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:20.112491 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-51a436d5-df02-410f-ac2c-3aba1b4d11b1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:20.112981 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-51a436d5-df02-410f-ac2c-3aba1b4d11b1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:20.113403 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-51a436d5-df02-410f-ac2c-3aba1b4d11b1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:20.118400 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:33:20.249109 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-51a436d5-df02-410f-ac2c-3aba1b4d11b1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:20.257072 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-51a436d5-df02-410f-ac2c-3aba1b4d11b1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:20.258511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-51a436d5-df02-410f-ac2c-3aba1b4d11b1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:20.259666 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-51a436d5-df02-410f-ac2c-3aba1b4d11b1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1599 microversion: 2.20 time: 0.160895 Sep 15 19:33:20.260227 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 537/806] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:33:20 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:33:20.286367 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-567cc307-0d53-4aa9-b680-8e61f239c092 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:20.286929 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-567cc307-0d53-4aa9-b680-8e61f239c092 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:20.293809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-567cc307-0d53-4aa9-b680-8e61f239c092 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:20.294609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-567cc307-0d53-4aa9-b680-8e61f239c092 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:20.294789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-567cc307-0d53-4aa9-b680-8e61f239c092 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:20.295531 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-567cc307-0d53-4aa9-b680-8e61f239c092 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:20.296011 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-567cc307-0d53-4aa9-b680-8e61f239c092 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:20.296428 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-567cc307-0d53-4aa9-b680-8e61f239c092 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:20.380683 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-567cc307-0d53-4aa9-b680-8e61f239c092 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097116 Sep 15 19:33:20.380683 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 538/807] 10.222.0.18 () {60 vars in 1316 bytes} [Thu Sep 15 19:33:20 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 19:33:21.446147 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-34bf66c2-b016-4db3-9414-a3323d39d45a req-64fef6f6-0f09-47ea-ab1f-e220e629e430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4", "tag": "143ce322-19a2-43c5-83ec-ba67ce8ce7cc"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:33:21.456558 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-34bf66c2-b016-4db3-9414-a3323d39d45a req-64fef6f6-0f09-47ea-ab1f-e220e629e430 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:21.457731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-34bf66c2-b016-4db3-9414-a3323d39d45a req-64fef6f6-0f09-47ea-ab1f-e220e629e430 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:21.457731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-34bf66c2-b016-4db3-9414-a3323d39d45a req-64fef6f6-0f09-47ea-ab1f-e220e629e430 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:21.470422 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-34bf66c2-b016-4db3-9414-a3323d39d45a req-64fef6f6-0f09-47ea-ab1f-e220e629e430 service nova] Creating event network-changed:143ce322-19a2-43c5-83ec-ba67ce8ce7cc for instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 on hv-cinder-84984 Sep 15 19:33:21.476085 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-34bf66c2-b016-4db3-9414-a3323d39d45a req-64fef6f6-0f09-47ea-ab1f-e220e629e430 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034426 Sep 15 19:33:21.476864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 539/808] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:33:32.724170 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:33:32.724930 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=10 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:33:32.729208 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4c9c6c50-9090-4369-8721-12dad5af4ee4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:32.729800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4c9c6c50-9090-4369-8721-12dad5af4ee4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:32.736265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c9c6c50-9090-4369-8721-12dad5af4ee4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:32.739785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c9c6c50-9090-4369-8721-12dad5af4ee4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:32.739785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c9c6c50-9090-4369-8721-12dad5af4ee4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:32.739785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c9c6c50-9090-4369-8721-12dad5af4ee4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:32.739785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c9c6c50-9090-4369-8721-12dad5af4ee4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:32.740280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c9c6c50-9090-4369-8721-12dad5af4ee4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:32.762998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4c9c6c50-9090-4369-8721-12dad5af4ee4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62/ips" status: 200 len: 149 microversion: 2.1 time: 0.040634 Sep 15 19:33:32.763560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 540/809] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 15 19:33:32 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:33:35.558800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-64e5c41d-f140-42bc-8a53-f47661e54ba4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c557fde-7074-4980-beca-ffb339d90f13"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:33:35.561636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-64e5c41d-f140-42bc-8a53-f47661e54ba4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:35.569530 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-64e5c41d-f140-42bc-8a53-f47661e54ba4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:35.569664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-64e5c41d-f140-42bc-8a53-f47661e54ba4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:35.570084 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-64e5c41d-f140-42bc-8a53-f47661e54ba4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:35.570780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-64e5c41d-f140-42bc-8a53-f47661e54ba4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:35.571229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-64e5c41d-f140-42bc-8a53-f47661e54ba4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:35.571808 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-64e5c41d-f140-42bc-8a53-f47661e54ba4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:36.395124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-64e5c41d-f140-42bc-8a53-f47661e54ba4 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "POST /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840314 Sep 15 19:33:36.395673 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 541/810] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:33:35 2022] POST /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62/os-volume_attachments => generated 194 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:33:40.603784 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 19:33:40.604351 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Thu Sep 15 19:33:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Sep 15 19:33:44.085812 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2095b6bf-b2b5-484e-a282-74a906855e66 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:44.086669 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2095b6bf-b2b5-484e-a282-74a906855e66 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:44.094087 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2095b6bf-b2b5-484e-a282-74a906855e66 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:44.099534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2095b6bf-b2b5-484e-a282-74a906855e66 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:44.099534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2095b6bf-b2b5-484e-a282-74a906855e66 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:44.099534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2095b6bf-b2b5-484e-a282-74a906855e66 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:44.099534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2095b6bf-b2b5-484e-a282-74a906855e66 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:44.100295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2095b6bf-b2b5-484e-a282-74a906855e66 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:44.100391 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 19:33:44.100391 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Thu Sep 15 19:33:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Sep 15 19:33:44.185200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-2095b6bf-b2b5-484e-a282-74a906855e66 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lazy-loading 'services' on Instance uuid f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:33:44.457541 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2095b6bf-b2b5-484e-a282-74a906855e66 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62/os-volume_attachments/5c557fde-7074-4980-beca-ffb339d90f13" status: 202 len: 0 microversion: 2.1 time: 0.376916 Sep 15 19:33:44.458130 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 542/811] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 15 19:33:44 2022] DELETE /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62/os-volume_attachments/5c557fde-7074-4980-beca-ffb339d90f13 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 19:33:44.467411 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-aae24952-52f0-409b-b797-de9c1c5e6f22 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:44.470039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-aae24952-52f0-409b-b797-de9c1c5e6f22 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:44.477085 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aae24952-52f0-409b-b797-de9c1c5e6f22 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:44.477568 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aae24952-52f0-409b-b797-de9c1c5e6f22 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:44.478059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aae24952-52f0-409b-b797-de9c1c5e6f22 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:44.478722 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aae24952-52f0-409b-b797-de9c1c5e6f22 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:44.479200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aae24952-52f0-409b-b797-de9c1c5e6f22 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:44.479623 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aae24952-52f0-409b-b797-de9c1c5e6f22 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:44.512931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-aae24952-52f0-409b-b797-de9c1c5e6f22 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049773 Sep 15 19:33:44.513723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 543/812] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:33:44 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:33:45.526449 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ae7d9d27-3293-4152-9e32-484733f38220 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:45.528841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ae7d9d27-3293-4152-9e32-484733f38220 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:45.535781 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae7d9d27-3293-4152-9e32-484733f38220 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:45.536323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae7d9d27-3293-4152-9e32-484733f38220 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:45.538669 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae7d9d27-3293-4152-9e32-484733f38220 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:45.538669 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae7d9d27-3293-4152-9e32-484733f38220 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:45.538669 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae7d9d27-3293-4152-9e32-484733f38220 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:45.538669 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae7d9d27-3293-4152-9e32-484733f38220 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:45.568799 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ae7d9d27-3293-4152-9e32-484733f38220 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046472 Sep 15 19:33:45.569389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 544/813] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:33:45 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 19:33:45.636038 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d5c819f1-d87e-4cc0-b267-6305fc784b5c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:45.636544 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d5c819f1-d87e-4cc0-b267-6305fc784b5c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:45.643331 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5c819f1-d87e-4cc0-b267-6305fc784b5c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:45.643859 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5c819f1-d87e-4cc0-b267-6305fc784b5c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:45.644298 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5c819f1-d87e-4cc0-b267-6305fc784b5c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:45.644985 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5c819f1-d87e-4cc0-b267-6305fc784b5c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:45.645560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5c819f1-d87e-4cc0-b267-6305fc784b5c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:45.646097 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5c819f1-d87e-4cc0-b267-6305fc784b5c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:45.672205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d5c819f1-d87e-4cc0-b267-6305fc784b5c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:33:46.076578 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d5c819f1-d87e-4cc0-b267-6305fc784b5c tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 204 len: 0 microversion: 2.1 time: 0.444232 Sep 15 19:33:46.077251 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 545/814] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:33:45 2022] DELETE /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 19:33:46.086622 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-878cc8b3-5b58-411d-be43-db63045545be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:46.087341 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-878cc8b3-5b58-411d-be43-db63045545be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:46.094538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-878cc8b3-5b58-411d-be43-db63045545be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:46.095031 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-878cc8b3-5b58-411d-be43-db63045545be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:46.095468 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-878cc8b3-5b58-411d-be43-db63045545be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:46.096197 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-878cc8b3-5b58-411d-be43-db63045545be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:46.096763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-878cc8b3-5b58-411d-be43-db63045545be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:46.097187 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-878cc8b3-5b58-411d-be43-db63045545be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:46.234030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-878cc8b3-5b58-411d-be43-db63045545be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:46.241859 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-878cc8b3-5b58-411d-be43-db63045545be tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1680 microversion: 2.1 time: 0.159482 Sep 15 19:33:46.242427 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 546/815] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:46 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:33:47.281072 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4c16171e-6fe1-44b8-baac-bea5bcebca1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:47.281732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4c16171e-6fe1-44b8-baac-bea5bcebca1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:47.287555 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c16171e-6fe1-44b8-baac-bea5bcebca1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:47.288066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c16171e-6fe1-44b8-baac-bea5bcebca1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:47.288496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c16171e-6fe1-44b8-baac-bea5bcebca1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:47.289183 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c16171e-6fe1-44b8-baac-bea5bcebca1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:47.289635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c16171e-6fe1-44b8-baac-bea5bcebca1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:47.290054 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c16171e-6fe1-44b8-baac-bea5bcebca1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:47.314080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4c16171e-6fe1-44b8-baac-bea5bcebca1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/ips" status: 200 len: 145 microversion: 2.1 time: 0.138670 Sep 15 19:33:47.314636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 547/816] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 15 19:33:47 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/ips => generated 145 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:33:47.318953 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f5e72307-dd8f-474a-b8fc-499e749de278 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:47.319556 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f5e72307-dd8f-474a-b8fc-499e749de278 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:47.327237 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f5e72307-dd8f-474a-b8fc-499e749de278 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:47.327671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f5e72307-dd8f-474a-b8fc-499e749de278 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:47.328134 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f5e72307-dd8f-474a-b8fc-499e749de278 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:47.328858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f5e72307-dd8f-474a-b8fc-499e749de278 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:47.329323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f5e72307-dd8f-474a-b8fc-499e749de278 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:47.329750 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f5e72307-dd8f-474a-b8fc-499e749de278 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:47.464852 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f5e72307-dd8f-474a-b8fc-499e749de278 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:47.472822 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f5e72307-dd8f-474a-b8fc-499e749de278 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1680 microversion: 2.1 time: 0.157163 Sep 15 19:33:47.473411 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 548/817] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:47 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:33:48.498783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e48d96f2-1b0a-40e0-90c2-e43f27f394c3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:48.499738 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e48d96f2-1b0a-40e0-90c2-e43f27f394c3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:48.508186 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e48d96f2-1b0a-40e0-90c2-e43f27f394c3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:48.508671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e48d96f2-1b0a-40e0-90c2-e43f27f394c3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:48.509111 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e48d96f2-1b0a-40e0-90c2-e43f27f394c3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:48.509835 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e48d96f2-1b0a-40e0-90c2-e43f27f394c3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:48.510284 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e48d96f2-1b0a-40e0-90c2-e43f27f394c3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:48.510707 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e48d96f2-1b0a-40e0-90c2-e43f27f394c3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:48.747437 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e48d96f2-1b0a-40e0-90c2-e43f27f394c3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:48.755865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e48d96f2-1b0a-40e0-90c2-e43f27f394c3 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1680 microversion: 2.1 time: 0.261809 Sep 15 19:33:48.756370 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 549/818] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:48 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:33:49.202936 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-62aa267a-8a36-4e95-bd60-76fee45398c4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fce50960-4121-4565-972e-93f4dae7cee9"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:33:49.205428 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-62aa267a-8a36-4e95-bd60-76fee45398c4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:49.211720 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62aa267a-8a36-4e95-bd60-76fee45398c4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:49.212212 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62aa267a-8a36-4e95-bd60-76fee45398c4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:49.212652 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62aa267a-8a36-4e95-bd60-76fee45398c4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:49.216245 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62aa267a-8a36-4e95-bd60-76fee45398c4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:49.216245 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62aa267a-8a36-4e95-bd60-76fee45398c4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:49.216245 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62aa267a-8a36-4e95-bd60-76fee45398c4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:50.412706 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-62aa267a-8a36-4e95-bd60-76fee45398c4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "POST /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.213386 Sep 15 19:33:50.412706 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 550/819] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:33:49 2022] POST /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments => generated 194 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:33:50.418822 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-8b8d74d6-63b6-4c50-9683-aca57bd219ca req-eaaad2c0-5f5f-48be-b726-e2849b0e4c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c1a3e2-eab3-4cc3-b737-d88f242ecb62", "name": "network-vif-deleted", "tag": "7433f2f7-bf4d-4108-9055-048e5b317dbb"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:33:50.428931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-8b8d74d6-63b6-4c50-9683-aca57bd219ca req-eaaad2c0-5f5f-48be-b726-e2849b0e4c82 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:50.429482 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-8b8d74d6-63b6-4c50-9683-aca57bd219ca req-eaaad2c0-5f5f-48be-b726-e2849b0e4c82 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:50.429918 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-8b8d74d6-63b6-4c50-9683-aca57bd219ca req-eaaad2c0-5f5f-48be-b726-e2849b0e4c82 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:50.442020 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-8b8d74d6-63b6-4c50-9683-aca57bd219ca req-eaaad2c0-5f5f-48be-b726-e2849b0e4c82 service nova] Creating event network-vif-deleted:7433f2f7-bf4d-4108-9055-048e5b317dbb for instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 on hv-cinder-84984 Sep 15 19:33:50.446983 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-8b8d74d6-63b6-4c50-9683-aca57bd219ca req-eaaad2c0-5f5f-48be-b726-e2849b0e4c82 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032394 Sep 15 19:33:50.447603 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 551/820] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:33:50.453847 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:50.454570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:50.461106 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:50.461599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:50.462041 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:50.462769 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:50.463506 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:50.463881 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:50.496421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:50.497018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:50.497458 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:50.497910 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lazy-loading 'fault' on Instance uuid f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:33:50.501997 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:33:50.541437 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e37c8ca70ad4b6e8430a71d0f5e564f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ec78c2e65c4f0c86d505c409031ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:33:50.549066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5ad34cdf-0d2a-4bed-9935-ba67db99a83e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 200 len: 1331 microversion: 2.1 time: 0.100272 Sep 15 19:33:50.549628 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 552/821] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:50 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:33:51.572708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2b5bf990-65d8-47c8-bda9-c1f5c415e44e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:51.573347 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2b5bf990-65d8-47c8-bda9-c1f5c415e44e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:51.580419 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2b5bf990-65d8-47c8-bda9-c1f5c415e44e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:51.580895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2b5bf990-65d8-47c8-bda9-c1f5c415e44e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:51.581406 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2b5bf990-65d8-47c8-bda9-c1f5c415e44e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:51.582070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2b5bf990-65d8-47c8-bda9-c1f5c415e44e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:51.582518 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2b5bf990-65d8-47c8-bda9-c1f5c415e44e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:51.582940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2b5bf990-65d8-47c8-bda9-c1f5c415e44e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:51.596760 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-2b5bf990-65d8-47c8-bda9-c1f5c415e44e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2b5bf990-65d8-47c8-bda9-c1f5c415e44e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 HTTP/1.1 Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:33:51.598431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:33:51.600127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:33:51.600127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:51.600127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:51.600127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:51.600127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:51.600127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:33:51.600127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:33:51.600127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:33:51.600127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:51.600127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:33:51.600127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:51.600127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'f9c1a3e2-eab3-4cc3-b737-d88f242ecb62'} Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:33:51.601018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:51.602500 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:51.603915 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2b5bf990-65d8-47c8-bda9-c1f5c415e44e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 404 to user: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:33:51.603915 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2b5bf990-65d8-47c8-bda9-c1f5c415e44e tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 404 len: 111 microversion: 2.1 time: 0.031092 Sep 15 19:33:51.603915 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 553/822] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:51 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:33:51.609373 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-20c4222f-4e83-44b1-80ea-c4be143e40f6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '.version_select at 0x7f551e9c1820>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:51.718761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-20c4222f-4e83-44b1-80ea-c4be143e40f6 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123975815" status: 202 len: 0 microversion: 2.1 time: 0.113698 Sep 15 19:33:51.719317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 554/823] 10.222.0.18 () {58 vars in 1221 bytes} [Thu Sep 15 19:33:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123975815 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 19:33:53.948480 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b21b46e6-f7d6-4955-8d78-02edffa1e1a5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:53.949046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b21b46e6-f7d6-4955-8d78-02edffa1e1a5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:53.956212 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b21b46e6-f7d6-4955-8d78-02edffa1e1a5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:53.956689 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b21b46e6-f7d6-4955-8d78-02edffa1e1a5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:53.957119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b21b46e6-f7d6-4955-8d78-02edffa1e1a5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:53.957807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b21b46e6-f7d6-4955-8d78-02edffa1e1a5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:53.958254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b21b46e6-f7d6-4955-8d78-02edffa1e1a5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:53.958673 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b21b46e6-f7d6-4955-8d78-02edffa1e1a5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:53.972219 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-b21b46e6-f7d6-4955-8d78-02edffa1e1a5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b21b46e6-f7d6-4955-8d78-02edffa1e1a5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 HTTP/1.1 Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:33:53.973789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:33:53.976433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:33:53.976433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:53.976433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:53.976433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:53.976433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:53.976433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:33:53.976433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:33:53.976433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:33:53.976433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:53.976433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:33:53.976433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:53.976433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'f9c1a3e2-eab3-4cc3-b737-d88f242ecb62'} Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:33:53.977957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:53.980263 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:53.981575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b21b46e6-f7d6-4955-8d78-02edffa1e1a5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 404 to user: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:33:53.981575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b21b46e6-f7d6-4955-8d78-02edffa1e1a5 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 404 len: 111 microversion: 2.1 time: 0.032844 Sep 15 19:33:53.981575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 555/824] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:33:53 2022] DELETE /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:33:53.985885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-729d5647-9979-4dba-87d6-e9cbc9148597 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:53.986499 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-729d5647-9979-4dba-87d6-e9cbc9148597 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: f9c1a3e2-eab3-4cc3-b737-d88f242ecb62] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:53.992755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-729d5647-9979-4dba-87d6-e9cbc9148597 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:53.993253 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-729d5647-9979-4dba-87d6-e9cbc9148597 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:53.993675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-729d5647-9979-4dba-87d6-e9cbc9148597 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:53.994380 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-729d5647-9979-4dba-87d6-e9cbc9148597 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:53.994836 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-729d5647-9979-4dba-87d6-e9cbc9148597 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:53.995258 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-729d5647-9979-4dba-87d6-e9cbc9148597 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:54.009157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-729d5647-9979-4dba-87d6-e9cbc9148597 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-729d5647-9979-4dba-87d6-e9cbc9148597 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 HTTP/1.1 Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:33:54.011052 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:33:54.013613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:33:54.013613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:54.013613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:54.013613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:54.013613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:54.013613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:33:54.013613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:33:54.013613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:33:54.013613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:54.013613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:33:54.013613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:54.013613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'f9c1a3e2-eab3-4cc3-b737-d88f242ecb62'} Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:33:54.015121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. Sep 15 19:33:54.016840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:54.018203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-729d5647-9979-4dba-87d6-e9cbc9148597 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 404 to user: Instance f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:33:54.018203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-729d5647-9979-4dba-87d6-e9cbc9148597 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62" status: 404 len: 111 microversion: 2.1 time: 0.031047 Sep 15 19:33:54.018203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 556/825] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:53 2022] GET /compute/v2.1/servers/f9c1a3e2-eab3-4cc3-b737-d88f242ecb62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:33:55.299225 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ef58931c-c3ef-482e-a2c0-18ffb81e1e36 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:55.299870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ef58931c-c3ef-482e-a2c0-18ffb81e1e36 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:55.306262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef58931c-c3ef-482e-a2c0-18ffb81e1e36 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:55.306844 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef58931c-c3ef-482e-a2c0-18ffb81e1e36 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:55.307278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef58931c-c3ef-482e-a2c0-18ffb81e1e36 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:55.307991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef58931c-c3ef-482e-a2c0-18ffb81e1e36 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:55.308440 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef58931c-c3ef-482e-a2c0-18ffb81e1e36 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:55.308858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef58931c-c3ef-482e-a2c0-18ffb81e1e36 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:55.323018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-ef58931c-c3ef-482e-a2c0-18ffb81e1e36 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ef58931c-c3ef-482e-a2c0-18ffb81e1e36 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 HTTP/1.1 Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:33:55.324588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:33:55.326233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:33:55.326233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:55.326233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:55.326233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:55.326233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:55.326233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:33:55.326233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:33:55.326233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:33:55.326233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:55.326233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:33:55.326233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:33:55.326233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '958ffdf6-6239-4d43-a0ba-0769a4b3cfa4'} Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:33:55.327015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:33:55.328265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.329546 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ef58931c-c3ef-482e-a2c0-18ffb81e1e36 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 404 to user: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:33:55.329546 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ef58931c-c3ef-482e-a2c0-18ffb81e1e36 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 404 len: 111 microversion: 2.1 time: 0.030616 Sep 15 19:33:55.329546 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 557/826] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:33:55 2022] DELETE /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:33:55.337968 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-79ea4341-6e13-46fc-8ade-ab957eafe277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:55.338582 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-79ea4341-6e13-46fc-8ade-ab957eafe277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:55.345607 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-79ea4341-6e13-46fc-8ade-ab957eafe277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:55.346096 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-79ea4341-6e13-46fc-8ade-ab957eafe277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:55.346538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-79ea4341-6e13-46fc-8ade-ab957eafe277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:55.347245 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-79ea4341-6e13-46fc-8ade-ab957eafe277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:55.347728 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-79ea4341-6e13-46fc-8ade-ab957eafe277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:55.348185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-79ea4341-6e13-46fc-8ade-ab957eafe277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:55.365258 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-79ea4341-6e13-46fc-8ade-ab957eafe277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-79ea4341-6e13-46fc-8ade-ab957eafe277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 HTTP/1.1 Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:33:55.366826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:33:55.368433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:33:55.368433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:55.368433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:55.368433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:55.368433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:55.368433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:33:55.368433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:33:55.368433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:33:55.368433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:55.368433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:33:55.368433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:33:55.368433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '958ffdf6-6239-4d43-a0ba-0769a4b3cfa4'} Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:33:55.369248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. Sep 15 19:33:55.370842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.372695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-79ea4341-6e13-46fc-8ade-ab957eafe277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 404 to user: Instance 958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:33:55.372695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-79ea4341-6e13-46fc-8ade-ab957eafe277 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4" status: 404 len: 111 microversion: 2.1 time: 0.034054 Sep 15 19:33:55.372695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 558/827] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:55 2022] GET /compute/v2.1/servers/958ffdf6-6239-4d43-a0ba-0769a4b3cfa4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:33:55.377294 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-39411927-4ac1-45f2-923b-703ff1910500 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:55.377790 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-39411927-4ac1-45f2-923b-703ff1910500 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:55.383964 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-39411927-4ac1-45f2-923b-703ff1910500 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:55.384452 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-39411927-4ac1-45f2-923b-703ff1910500 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:55.384896 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-39411927-4ac1-45f2-923b-703ff1910500 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:55.385611 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-39411927-4ac1-45f2-923b-703ff1910500 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:55.386071 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-39411927-4ac1-45f2-923b-703ff1910500 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:55.386506 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-39411927-4ac1-45f2-923b-703ff1910500 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:55.402091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-39411927-4ac1-45f2-923b-703ff1910500 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-39411927-4ac1-45f2-923b-703ff1910500 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f HTTP/1.1 Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:33:55.403680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:33:55.405677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:33:55.405677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:55.405677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:55.405677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:55.405677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:55.405677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:33:55.405677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:33:55.405677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:33:55.405677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:55.405677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:33:55.405677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:33:55.405677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '8c6cfa71-df2d-4e56-ba89-35f6153f327f'} Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:33:55.406656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:33:55.408303 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.409908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-39411927-4ac1-45f2-923b-703ff1910500 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 404 to user: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:33:55.409908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-39411927-4ac1-45f2-923b-703ff1910500 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 404 len: 111 microversion: 2.1 time: 0.032727 Sep 15 19:33:55.409908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 559/828] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:33:55 2022] DELETE /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:33:55.413836 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-26df3945-2aeb-4206-a822-de419645043a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:55.414449 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-26df3945-2aeb-4206-a822-de419645043a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 8c6cfa71-df2d-4e56-ba89-35f6153f327f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:55.421076 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26df3945-2aeb-4206-a822-de419645043a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:55.421560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26df3945-2aeb-4206-a822-de419645043a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:55.421997 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26df3945-2aeb-4206-a822-de419645043a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:55.422695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26df3945-2aeb-4206-a822-de419645043a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:55.423149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26df3945-2aeb-4206-a822-de419645043a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:55.423575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26df3945-2aeb-4206-a822-de419645043a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:55.437265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-26df3945-2aeb-4206-a822-de419645043a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-26df3945-2aeb-4206-a822-de419645043a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f HTTP/1.1 Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:33:55.438811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:33:55.440979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:33:55.440979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:55.440979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:55.440979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:55.440979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:55.440979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:33:55.440979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:33:55.440979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:33:55.440979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:55.440979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:33:55.440979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:33:55.440979 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '8c6cfa71-df2d-4e56-ba89-35f6153f327f'} Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:33:55.442162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. Sep 15 19:33:55.443714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:55.444944 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-26df3945-2aeb-4206-a822-de419645043a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 404 to user: Instance 8c6cfa71-df2d-4e56-ba89-35f6153f327f could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:33:55.444944 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-26df3945-2aeb-4206-a822-de419645043a tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f" status: 404 len: 111 microversion: 2.1 time: 0.030068 Sep 15 19:33:55.444944 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 560/829] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:55 2022] GET /compute/v2.1/servers/8c6cfa71-df2d-4e56-ba89-35f6153f327f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:33:56.794123 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-07b13474-19d6-4014-a2f8-bdef45986fd8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:56.794776 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-07b13474-19d6-4014-a2f8-bdef45986fd8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:56.800872 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07b13474-19d6-4014-a2f8-bdef45986fd8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:56.801361 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07b13474-19d6-4014-a2f8-bdef45986fd8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:56.801800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07b13474-19d6-4014-a2f8-bdef45986fd8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:56.802501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07b13474-19d6-4014-a2f8-bdef45986fd8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:56.802955 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07b13474-19d6-4014-a2f8-bdef45986fd8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:56.803382 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07b13474-19d6-4014-a2f8-bdef45986fd8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:56.820082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-07b13474-19d6-4014-a2f8-bdef45986fd8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-07b13474-19d6-4014-a2f8-bdef45986fd8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 HTTP/1.1 Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:33:56.821807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:33:56.823069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:33:56.823069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:56.823069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:56.823069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:56.823069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:56.823069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:33:56.823069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:33:56.823069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:33:56.823069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:56.823069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:33:56.823069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:33:56.823069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '3532b103-32ed-4f98-988c-acdaaca65fa8'} Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:33:56.823870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:33:56.825100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:56.828931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-07b13474-19d6-4014-a2f8-bdef45986fd8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 404 to user: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:33:56.828931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-07b13474-19d6-4014-a2f8-bdef45986fd8 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 404 len: 111 microversion: 2.1 time: 0.033508 Sep 15 19:33:56.828931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 561/830] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:33:56 2022] DELETE /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:33:56.834827 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8a64d312-c07a-4329-807a-b346f2411376 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:56.835087 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8a64d312-c07a-4329-807a-b346f2411376 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] [instance: 3532b103-32ed-4f98-988c-acdaaca65fa8] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:56.842921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a64d312-c07a-4329-807a-b346f2411376 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:56.848068 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a64d312-c07a-4329-807a-b346f2411376 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:56.848068 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a64d312-c07a-4329-807a-b346f2411376 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:56.848068 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a64d312-c07a-4329-807a-b346f2411376 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:56.848068 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a64d312-c07a-4329-807a-b346f2411376 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:56.848873 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a64d312-c07a-4329-807a-b346f2411376 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:56.859490 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-8a64d312-c07a-4329-807a-b346f2411376 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] HTTP exception thrown: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8a64d312-c07a-4329-807a-b346f2411376 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Request method failure captured: Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 HTTP/1.1 Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3x2jSjrSbDJZFFxTXW_21kuKccBxT3lFJua_-92zAIXutmQNWwFj2hdd1E7ulEv_stTY8rr34stbFq0YD0xPYNxs3S5UbXIjSGenuG7Q7rbDO9WpvJ4gHmMEM08213kk34T8u8VRtlLUIcs543NS5iVENDsiB-43_1G_Mwbum4FeTA Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:33:56.861330 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:33:56.862764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53ec78c2e65c4f0c86d505c409031ab6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53ec78c2e65c4f0c86d505c409031ab6"}]}] Sep 15 19:33:56.862764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:56.862764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 53ec78c2e65c4f0c86d505c409031ab6 Sep 15 19:33:56.862764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2110872770 Sep 15 19:33:56.862764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:56.862764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:33:56.862764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:33:56.862764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 0e37c8ca70ad4b6e8430a71d0f5e564f Sep 15 19:33:56.862764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-2110872770-project Sep 15 19:33:56.862764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:33:56.862764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:33:56.862764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '3532b103-32ed-4f98-988c-acdaaca65fa8'} Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:33:56.863514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. Sep 15 19:33:56.871806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:33:56.874250 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8a64d312-c07a-4329-807a-b346f2411376 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] Returning 404 to user: Instance 3532b103-32ed-4f98-988c-acdaaca65fa8 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:33:56.874250 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8a64d312-c07a-4329-807a-b346f2411376 tempest-AttachVolumeNegativeTest-2110872770 tempest-AttachVolumeNegativeTest-2110872770-project] 10.222.0.18 "GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8" status: 404 len: 111 microversion: 2.1 time: 0.032104 Sep 15 19:33:56.874250 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 562/831] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:33:56 2022] GET /compute/v2.1/servers/3532b103-32ed-4f98-988c-acdaaca65fa8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:33:58.009028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-508bdcc0-36a7-4de2-b1b9-9ae994310e1c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:58.011261 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-508bdcc0-36a7-4de2-b1b9-9ae994310e1c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:58.018599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-508bdcc0-36a7-4de2-b1b9-9ae994310e1c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:58.019092 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-508bdcc0-36a7-4de2-b1b9-9ae994310e1c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:58.019516 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-508bdcc0-36a7-4de2-b1b9-9ae994310e1c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:58.020246 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-508bdcc0-36a7-4de2-b1b9-9ae994310e1c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:58.020695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-508bdcc0-36a7-4de2-b1b9-9ae994310e1c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:58.021114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-508bdcc0-36a7-4de2-b1b9-9ae994310e1c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:58.059298 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-508bdcc0-36a7-4de2-b1b9-9ae994310e1c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054259 Sep 15 19:33:58.059895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 563/832] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:33:58 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:33:58.072904 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f1c7f8c3-b8fe-4f9b-8dc5-490abe144c3c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:33:58.073404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f1c7f8c3-b8fe-4f9b-8dc5-490abe144c3c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:58.080285 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1c7f8c3-b8fe-4f9b-8dc5-490abe144c3c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:58.080777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1c7f8c3-b8fe-4f9b-8dc5-490abe144c3c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:58.086063 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1c7f8c3-b8fe-4f9b-8dc5-490abe144c3c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:58.086063 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1c7f8c3-b8fe-4f9b-8dc5-490abe144c3c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:58.086063 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1c7f8c3-b8fe-4f9b-8dc5-490abe144c3c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:58.086063 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1c7f8c3-b8fe-4f9b-8dc5-490abe144c3c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:58.114730 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f1c7f8c3-b8fe-4f9b-8dc5-490abe144c3c tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments/fce50960-4121-4565-972e-93f4dae7cee9" status: 200 len: 194 microversion: 2.1 time: 0.045934 Sep 15 19:33:58.115339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 564/833] 10.222.0.18 () {58 vars in 1413 bytes} [Thu Sep 15 19:33:58 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments/fce50960-4121-4565-972e-93f4dae7cee9 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:33:59.872105 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-aad472a9-d600-43dd-b298-26df56ff23a4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4f6e667-35e2-4b37-a618-dd4c93ed4989"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:33:59.874591 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-aad472a9-d600-43dd-b298-26df56ff23a4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:33:59.886528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aad472a9-d600-43dd-b298-26df56ff23a4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:59.887470 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aad472a9-d600-43dd-b298-26df56ff23a4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:59.888952 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aad472a9-d600-43dd-b298-26df56ff23a4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:33:59.890148 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aad472a9-d600-43dd-b298-26df56ff23a4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:33:59.890916 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aad472a9-d600-43dd-b298-26df56ff23a4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:33:59.891625 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aad472a9-d600-43dd-b298-26df56ff23a4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:00.873439 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-aad472a9-d600-43dd-b298-26df56ff23a4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "POST /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.010131 Sep 15 19:34:00.874359 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 565/834] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 15 19:33:59 2022] POST /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments => generated 194 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:34:05.287877 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b794433f-9ed4-488d-b1b5-2d220374a8be tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:05.288532 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b794433f-9ed4-488d-b1b5-2d220374a8be tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:05.295203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b794433f-9ed4-488d-b1b5-2d220374a8be tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:05.295720 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b794433f-9ed4-488d-b1b5-2d220374a8be tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:05.296153 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b794433f-9ed4-488d-b1b5-2d220374a8be tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:05.296839 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b794433f-9ed4-488d-b1b5-2d220374a8be tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:05.297291 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b794433f-9ed4-488d-b1b5-2d220374a8be tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:05.299956 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b794433f-9ed4-488d-b1b5-2d220374a8be tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:05.321469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b794433f-9ed4-488d-b1b5-2d220374a8be tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/ips" status: 200 len: 150 microversion: 2.20 time: 0.038410 Sep 15 19:34:05.322030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 566/835] 10.222.0.18 () {60 vars in 1289 bytes} [Thu Sep 15 19:34:05 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 19:34:07.926172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1228a9a4-5c55-47bb-8035-b4e229fe5082 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:34:07.926931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1228a9a4-5c55-47bb-8035-b4e229fe5082 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:07.929314 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:34:07.934299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1228a9a4-5c55-47bb-8035-b4e229fe5082 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:07.936462 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1228a9a4-5c55-47bb-8035-b4e229fe5082 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:07.936462 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1228a9a4-5c55-47bb-8035-b4e229fe5082 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:07.936462 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1228a9a4-5c55-47bb-8035-b4e229fe5082 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:07.937892 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1228a9a4-5c55-47bb-8035-b4e229fe5082 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:07.937892 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1228a9a4-5c55-47bb-8035-b4e229fe5082 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:07.962389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-1228a9a4-5c55-47bb-8035-b4e229fe5082 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lazy-loading 'flavor' on Instance uuid f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:34:08.679635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1228a9a4-5c55-47bb-8035-b4e229fe5082 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "POST /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/action" status: 202 len: 0 microversion: 2.20 time: 0.757170 Sep 15 19:34:08.680412 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 567/836] 10.222.0.18 () {62 vars in 1319 bytes} [Thu Sep 15 19:34:07 2022] POST /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/action => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 19:34:08.689822 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a175c061-9aab-46c8-b94d-9e5a5558eda8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:08.695057 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a175c061-9aab-46c8-b94d-9e5a5558eda8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:08.698984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a175c061-9aab-46c8-b94d-9e5a5558eda8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:08.699475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a175c061-9aab-46c8-b94d-9e5a5558eda8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:08.699938 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a175c061-9aab-46c8-b94d-9e5a5558eda8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:08.701609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a175c061-9aab-46c8-b94d-9e5a5558eda8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:08.701737 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a175c061-9aab-46c8-b94d-9e5a5558eda8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:08.702129 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a175c061-9aab-46c8-b94d-9e5a5558eda8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:08.737220 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a175c061-9aab-46c8-b94d-9e5a5558eda8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052461 Sep 15 19:34:08.737796 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 568/837] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:34:08 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:34:08.742396 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b963c5f3-f97c-4ae5-b9fe-8a36c012864f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:08.742994 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b963c5f3-f97c-4ae5-b9fe-8a36c012864f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:08.749847 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b963c5f3-f97c-4ae5-b9fe-8a36c012864f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:08.750323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b963c5f3-f97c-4ae5-b9fe-8a36c012864f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:08.750748 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b963c5f3-f97c-4ae5-b9fe-8a36c012864f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:08.751432 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b963c5f3-f97c-4ae5-b9fe-8a36c012864f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:08.751900 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b963c5f3-f97c-4ae5-b9fe-8a36c012864f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:08.752322 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b963c5f3-f97c-4ae5-b9fe-8a36c012864f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:08.897748 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b963c5f3-f97c-4ae5-b9fe-8a36c012864f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:08.906233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b963c5f3-f97c-4ae5-b9fe-8a36c012864f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:08.913176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b963c5f3-f97c-4ae5-b9fe-8a36c012864f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:08.914623 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b963c5f3-f97c-4ae5-b9fe-8a36c012864f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1722 microversion: 2.20 time: 0.175857 Sep 15 19:34:08.915201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 569/838] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:08 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:34:08.923747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-97046f15-2cc7-46dd-9284-3a62a43d2df4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:08.924249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-97046f15-2cc7-46dd-9284-3a62a43d2df4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:08.932597 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97046f15-2cc7-46dd-9284-3a62a43d2df4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:08.933467 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97046f15-2cc7-46dd-9284-3a62a43d2df4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:08.934097 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97046f15-2cc7-46dd-9284-3a62a43d2df4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:08.934408 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97046f15-2cc7-46dd-9284-3a62a43d2df4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:08.935421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97046f15-2cc7-46dd-9284-3a62a43d2df4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:08.936381 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97046f15-2cc7-46dd-9284-3a62a43d2df4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:08.967507 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-97046f15-2cc7-46dd-9284-3a62a43d2df4 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments/fce50960-4121-4565-972e-93f4dae7cee9" status: 200 len: 194 microversion: 2.1 time: 0.050970 Sep 15 19:34:08.968350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 570/839] 10.222.0.18 () {58 vars in 1413 bytes} [Thu Sep 15 19:34:08 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments/fce50960-4121-4565-972e-93f4dae7cee9 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:34:08.981094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0112da5a-baac-4bb1-b9f7-285b6f9f1afc tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:08.981094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0112da5a-baac-4bb1-b9f7-285b6f9f1afc tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:08.991159 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0112da5a-baac-4bb1-b9f7-285b6f9f1afc tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:08.991753 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0112da5a-baac-4bb1-b9f7-285b6f9f1afc tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:08.992234 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0112da5a-baac-4bb1-b9f7-285b6f9f1afc tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:08.993117 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0112da5a-baac-4bb1-b9f7-285b6f9f1afc tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:08.993612 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0112da5a-baac-4bb1-b9f7-285b6f9f1afc tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:08.994157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0112da5a-baac-4bb1-b9f7-285b6f9f1afc tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:09.083551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-0112da5a-baac-4bb1-b9f7-285b6f9f1afc tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lazy-loading 'services' on Instance uuid d0bedbd2-0142-4af2-a367-257352a283a5 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:34:09.356745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0112da5a-baac-4bb1-b9f7-285b6f9f1afc tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments/fce50960-4121-4565-972e-93f4dae7cee9" status: 202 len: 0 microversion: 2.1 time: 0.380436 Sep 15 19:34:09.357274 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 571/840] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 15 19:34:08 2022] DELETE /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments/fce50960-4121-4565-972e-93f4dae7cee9 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:34:09.949708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-06a33996-113a-4e21-b49e-337145f64f9c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:09.950435 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-06a33996-113a-4e21-b49e-337145f64f9c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:09.957385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06a33996-113a-4e21-b49e-337145f64f9c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:09.957870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06a33996-113a-4e21-b49e-337145f64f9c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:09.958301 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06a33996-113a-4e21-b49e-337145f64f9c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:09.958998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06a33996-113a-4e21-b49e-337145f64f9c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:09.959480 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06a33996-113a-4e21-b49e-337145f64f9c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:09.959931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06a33996-113a-4e21-b49e-337145f64f9c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:09.977875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:34:10.090873 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-06a33996-113a-4e21-b49e-337145f64f9c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:10.098984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-06a33996-113a-4e21-b49e-337145f64f9c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:10.100460 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-06a33996-113a-4e21-b49e-337145f64f9c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:10.101656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-06a33996-113a-4e21-b49e-337145f64f9c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1722 microversion: 2.20 time: 0.156767 Sep 15 19:34:10.102211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 572/841] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:09 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:11.129185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9446455a-9be0-40b6-83b2-033f52776a6c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:11.129821 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9446455a-9be0-40b6-83b2-033f52776a6c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:11.136631 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9446455a-9be0-40b6-83b2-033f52776a6c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:11.137105 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9446455a-9be0-40b6-83b2-033f52776a6c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:11.137539 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9446455a-9be0-40b6-83b2-033f52776a6c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:11.138749 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9446455a-9be0-40b6-83b2-033f52776a6c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:11.139205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9446455a-9be0-40b6-83b2-033f52776a6c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:11.139623 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9446455a-9be0-40b6-83b2-033f52776a6c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:11.287869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9446455a-9be0-40b6-83b2-033f52776a6c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:11.296041 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9446455a-9be0-40b6-83b2-033f52776a6c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:11.297491 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9446455a-9be0-40b6-83b2-033f52776a6c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:11.298667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9446455a-9be0-40b6-83b2-033f52776a6c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1722 microversion: 2.20 time: 0.175117 Sep 15 19:34:11.299229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 573/842] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:11 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:12.325164 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-57a06c39-e7ea-41f7-8997-da63f86e2b3c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:12.325814 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-57a06c39-e7ea-41f7-8997-da63f86e2b3c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:12.331615 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57a06c39-e7ea-41f7-8997-da63f86e2b3c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:12.332128 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57a06c39-e7ea-41f7-8997-da63f86e2b3c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:12.332558 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57a06c39-e7ea-41f7-8997-da63f86e2b3c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:12.333249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57a06c39-e7ea-41f7-8997-da63f86e2b3c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:12.333693 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57a06c39-e7ea-41f7-8997-da63f86e2b3c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:12.334114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57a06c39-e7ea-41f7-8997-da63f86e2b3c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:12.473281 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-57a06c39-e7ea-41f7-8997-da63f86e2b3c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:12.481870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-57a06c39-e7ea-41f7-8997-da63f86e2b3c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:12.483316 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-57a06c39-e7ea-41f7-8997-da63f86e2b3c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:12.484588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-57a06c39-e7ea-41f7-8997-da63f86e2b3c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1722 microversion: 2.20 time: 0.163901 Sep 15 19:34:12.494064 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 574/843] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:12 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:12.834927 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f879c977-22f4-4324-aa30-ae23aba6ea1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:12.835420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f879c977-22f4-4324-aa30-ae23aba6ea1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:12.841630 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f879c977-22f4-4324-aa30-ae23aba6ea1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:12.845809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f879c977-22f4-4324-aa30-ae23aba6ea1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:12.845809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f879c977-22f4-4324-aa30-ae23aba6ea1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:12.845809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f879c977-22f4-4324-aa30-ae23aba6ea1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:12.845809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f879c977-22f4-4324-aa30-ae23aba6ea1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:12.846397 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f879c977-22f4-4324-aa30-ae23aba6ea1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:12.874231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f879c977-22f4-4324-aa30-ae23aba6ea1e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments/b4f6e667-35e2-4b37-a618-dd4c93ed4989" status: 200 len: 194 microversion: 2.1 time: 0.043364 Sep 15 19:34:12.874811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 575/844] 10.222.0.18 () {58 vars in 1413 bytes} [Thu Sep 15 19:34:12 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments/b4f6e667-35e2-4b37-a618-dd4c93ed4989 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:34:12.885573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2dffc99f-4b31-4971-bd8b-0c806b6b5fb8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:12.886162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2dffc99f-4b31-4971-bd8b-0c806b6b5fb8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:12.892589 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2dffc99f-4b31-4971-bd8b-0c806b6b5fb8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:12.893069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2dffc99f-4b31-4971-bd8b-0c806b6b5fb8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:12.893529 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2dffc99f-4b31-4971-bd8b-0c806b6b5fb8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:12.894223 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2dffc99f-4b31-4971-bd8b-0c806b6b5fb8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:12.894671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2dffc99f-4b31-4971-bd8b-0c806b6b5fb8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:12.895097 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2dffc99f-4b31-4971-bd8b-0c806b6b5fb8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:12.981478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-2dffc99f-4b31-4971-bd8b-0c806b6b5fb8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lazy-loading 'services' on Instance uuid d0bedbd2-0142-4af2-a367-257352a283a5 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:34:13.249425 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2dffc99f-4b31-4971-bd8b-0c806b6b5fb8 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments/b4f6e667-35e2-4b37-a618-dd4c93ed4989" status: 202 len: 0 microversion: 2.1 time: 0.366422 Sep 15 19:34:13.249733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 576/845] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 15 19:34:12 2022] DELETE /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments/b4f6e667-35e2-4b37-a618-dd4c93ed4989 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:34:13.511704 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b3402f42-cc00-4669-8c15-5e79fef31e2f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:13.512401 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b3402f42-cc00-4669-8c15-5e79fef31e2f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:13.520107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3402f42-cc00-4669-8c15-5e79fef31e2f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:13.520620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3402f42-cc00-4669-8c15-5e79fef31e2f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:13.527139 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3402f42-cc00-4669-8c15-5e79fef31e2f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:13.527139 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3402f42-cc00-4669-8c15-5e79fef31e2f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:13.527139 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3402f42-cc00-4669-8c15-5e79fef31e2f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:13.527139 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3402f42-cc00-4669-8c15-5e79fef31e2f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:13.671777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b3402f42-cc00-4669-8c15-5e79fef31e2f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:13.680172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b3402f42-cc00-4669-8c15-5e79fef31e2f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:13.681664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b3402f42-cc00-4669-8c15-5e79fef31e2f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:13.682879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b3402f42-cc00-4669-8c15-5e79fef31e2f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1722 microversion: 2.20 time: 0.176183 Sep 15 19:34:13.683421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 577/846] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:13 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:34:14.710413 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-32c84cd5-5fae-466e-add0-6203275a0a8f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:14.711111 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-32c84cd5-5fae-466e-add0-6203275a0a8f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:14.719338 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-32c84cd5-5fae-466e-add0-6203275a0a8f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:14.719865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-32c84cd5-5fae-466e-add0-6203275a0a8f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:14.720334 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-32c84cd5-5fae-466e-add0-6203275a0a8f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:14.721039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-32c84cd5-5fae-466e-add0-6203275a0a8f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:14.721492 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-32c84cd5-5fae-466e-add0-6203275a0a8f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:14.721918 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-32c84cd5-5fae-466e-add0-6203275a0a8f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:14.860806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-32c84cd5-5fae-466e-add0-6203275a0a8f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:14.869687 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-32c84cd5-5fae-466e-add0-6203275a0a8f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:14.871161 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-32c84cd5-5fae-466e-add0-6203275a0a8f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:14.872439 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-32c84cd5-5fae-466e-add0-6203275a0a8f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1722 microversion: 2.20 time: 0.166129 Sep 15 19:34:14.873352 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 578/847] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:14 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:15.502147 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8b72cb13-f69e-4f90-8ab3-761487e0a6f5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:15.504432 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8b72cb13-f69e-4f90-8ab3-761487e0a6f5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:15.510810 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8b72cb13-f69e-4f90-8ab3-761487e0a6f5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:15.511285 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8b72cb13-f69e-4f90-8ab3-761487e0a6f5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:15.511744 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8b72cb13-f69e-4f90-8ab3-761487e0a6f5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:15.512441 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8b72cb13-f69e-4f90-8ab3-761487e0a6f5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:15.512886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8b72cb13-f69e-4f90-8ab3-761487e0a6f5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:15.513328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8b72cb13-f69e-4f90-8ab3-761487e0a6f5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:15.544397 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8b72cb13-f69e-4f90-8ab3-761487e0a6f5 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046975 Sep 15 19:34:15.544992 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 579/848] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:34:15 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 19:34:15.710173 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-30bd1057-d2e3-48bf-9bb0-0a4bde7ea972 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:15.712425 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-30bd1057-d2e3-48bf-9bb0-0a4bde7ea972 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:15.719519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30bd1057-d2e3-48bf-9bb0-0a4bde7ea972 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:15.722759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30bd1057-d2e3-48bf-9bb0-0a4bde7ea972 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:15.722759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30bd1057-d2e3-48bf-9bb0-0a4bde7ea972 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:15.722759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30bd1057-d2e3-48bf-9bb0-0a4bde7ea972 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:15.722759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30bd1057-d2e3-48bf-9bb0-0a4bde7ea972 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:15.723213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30bd1057-d2e3-48bf-9bb0-0a4bde7ea972 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:15.752290 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-30bd1057-d2e3-48bf-9bb0-0a4bde7ea972 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046394 Sep 15 19:34:15.752855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 580/849] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 15 19:34:15 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 19:34:15.817381 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dc33a5f2-cd6b-4309-994a-896720dc4475 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:15.817887 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-dc33a5f2-cd6b-4309-994a-896720dc4475 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:15.823790 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dc33a5f2-cd6b-4309-994a-896720dc4475 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:15.824265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dc33a5f2-cd6b-4309-994a-896720dc4475 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:15.831758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dc33a5f2-cd6b-4309-994a-896720dc4475 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:15.831758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dc33a5f2-cd6b-4309-994a-896720dc4475 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:15.831758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dc33a5f2-cd6b-4309-994a-896720dc4475 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:15.831758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dc33a5f2-cd6b-4309-994a-896720dc4475 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:15.852977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-dc33a5f2-cd6b-4309-994a-896720dc4475 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:34:16.298719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dc33a5f2-cd6b-4309-994a-896720dc4475 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 204 len: 0 microversion: 2.1 time: 0.484975 Sep 15 19:34:16.299712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 581/850] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:34:15 2022] DELETE /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 19:34:16.312190 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f6660d0d-1aeb-4e6b-bdc0-166ecaef6c82 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:16.312190 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f6660d0d-1aeb-4e6b-bdc0-166ecaef6c82 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:16.312637 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6660d0d-1aeb-4e6b-bdc0-166ecaef6c82 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:16.312959 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6660d0d-1aeb-4e6b-bdc0-166ecaef6c82 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:16.313394 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6660d0d-1aeb-4e6b-bdc0-166ecaef6c82 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:16.314094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6660d0d-1aeb-4e6b-bdc0-166ecaef6c82 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:16.314544 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6660d0d-1aeb-4e6b-bdc0-166ecaef6c82 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:16.314968 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6660d0d-1aeb-4e6b-bdc0-166ecaef6c82 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:16.459418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f6660d0d-1aeb-4e6b-bdc0-166ecaef6c82 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:16.468323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f6660d0d-1aeb-4e6b-bdc0-166ecaef6c82 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:16.470441 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f6660d0d-1aeb-4e6b-bdc0-166ecaef6c82 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:16.471642 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f6660d0d-1aeb-4e6b-bdc0-166ecaef6c82 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1722 microversion: 2.20 time: 0.170996 Sep 15 19:34:16.472231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 582/851] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:16 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:34:16.476857 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-03a2686e-02e4-4f86-bb1b-2111201a5ab7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:16.477484 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-03a2686e-02e4-4f86-bb1b-2111201a5ab7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:16.483421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03a2686e-02e4-4f86-bb1b-2111201a5ab7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:16.484102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03a2686e-02e4-4f86-bb1b-2111201a5ab7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:16.484578 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03a2686e-02e4-4f86-bb1b-2111201a5ab7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:16.485251 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03a2686e-02e4-4f86-bb1b-2111201a5ab7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:16.485705 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03a2686e-02e4-4f86-bb1b-2111201a5ab7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:16.486134 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03a2686e-02e4-4f86-bb1b-2111201a5ab7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:16.627453 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-03a2686e-02e4-4f86-bb1b-2111201a5ab7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:16.635195 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-03a2686e-02e4-4f86-bb1b-2111201a5ab7 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1673 microversion: 2.1 time: 0.161982 Sep 15 19:34:16.635792 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 583/852] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:34:16 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:34:17.497305 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9d5737c9-f809-43df-b17c-200d6a84f0c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:17.498202 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9d5737c9-f809-43df-b17c-200d6a84f0c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:17.504764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d5737c9-f809-43df-b17c-200d6a84f0c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:17.505253 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d5737c9-f809-43df-b17c-200d6a84f0c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:17.505691 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d5737c9-f809-43df-b17c-200d6a84f0c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:17.506404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d5737c9-f809-43df-b17c-200d6a84f0c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:17.506914 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d5737c9-f809-43df-b17c-200d6a84f0c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:17.507334 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d5737c9-f809-43df-b17c-200d6a84f0c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:17.657742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9d5737c9-f809-43df-b17c-200d6a84f0c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:17.666107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9d5737c9-f809-43df-b17c-200d6a84f0c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:17.667582 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9d5737c9-f809-43df-b17c-200d6a84f0c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:17.668976 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9d5737c9-f809-43df-b17c-200d6a84f0c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1722 microversion: 2.20 time: 0.175470 Sep 15 19:34:17.669339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 584/853] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:17 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:17.674083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7dc2c49a-481e-4c06-b590-e12914df9f3b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:17.674704 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7dc2c49a-481e-4c06-b590-e12914df9f3b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:17.680759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7dc2c49a-481e-4c06-b590-e12914df9f3b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:17.681262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7dc2c49a-481e-4c06-b590-e12914df9f3b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:17.681706 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7dc2c49a-481e-4c06-b590-e12914df9f3b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:17.682414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7dc2c49a-481e-4c06-b590-e12914df9f3b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:17.682874 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7dc2c49a-481e-4c06-b590-e12914df9f3b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:17.683297 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7dc2c49a-481e-4c06-b590-e12914df9f3b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:17.853977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7dc2c49a-481e-4c06-b590-e12914df9f3b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:17.853977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7dc2c49a-481e-4c06-b590-e12914df9f3b tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1673 microversion: 2.1 time: 0.175281 Sep 15 19:34:17.853977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 585/854] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:34:17 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:34:18.709651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4a33f575-6e5c-4766-9f92-8e75cf38c6c5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:18.710398 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4a33f575-6e5c-4766-9f92-8e75cf38c6c5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:18.717248 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a33f575-6e5c-4766-9f92-8e75cf38c6c5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:18.717746 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a33f575-6e5c-4766-9f92-8e75cf38c6c5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:18.718311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a33f575-6e5c-4766-9f92-8e75cf38c6c5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:18.719043 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a33f575-6e5c-4766-9f92-8e75cf38c6c5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:18.719624 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a33f575-6e5c-4766-9f92-8e75cf38c6c5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:18.720068 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a33f575-6e5c-4766-9f92-8e75cf38c6c5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:18.946512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4a33f575-6e5c-4766-9f92-8e75cf38c6c5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:18.952210 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:34:18.968309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4a33f575-6e5c-4766-9f92-8e75cf38c6c5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:18.970425 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4a33f575-6e5c-4766-9f92-8e75cf38c6c5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:18.971608 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4a33f575-6e5c-4766-9f92-8e75cf38c6c5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1722 microversion: 2.20 time: 0.266090 Sep 15 19:34:18.972182 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 586/855] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:18 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:18.991170 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b536b738-bfa0-47c7-ac44-66241a829e5e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:18.991933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b536b738-bfa0-47c7-ac44-66241a829e5e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:18.997997 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b536b738-bfa0-47c7-ac44-66241a829e5e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:18.998483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b536b738-bfa0-47c7-ac44-66241a829e5e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:18.998920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b536b738-bfa0-47c7-ac44-66241a829e5e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:18.999715 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b536b738-bfa0-47c7-ac44-66241a829e5e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:19.000171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b536b738-bfa0-47c7-ac44-66241a829e5e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:19.000608 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b536b738-bfa0-47c7-ac44-66241a829e5e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:19.246691 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b536b738-bfa0-47c7-ac44-66241a829e5e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:19.256687 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b536b738-bfa0-47c7-ac44-66241a829e5e tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1673 microversion: 2.1 time: 0.269655 Sep 15 19:34:19.257383 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 587/856] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:34:18 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1673 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:34:19.453739 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-80506484-998c-4dc6-9907-fc3dc7e784d2 req-8f0f7a6b-4569-440b-bf2d-5c41ec6542ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0bedbd2-0142-4af2-a367-257352a283a5", "name": "network-vif-deleted", "tag": "bd84b30a-cc10-459e-ab2e-bf61f225c610"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:34:19.472348 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-80506484-998c-4dc6-9907-fc3dc7e784d2 req-8f0f7a6b-4569-440b-bf2d-5c41ec6542ef service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:19.473129 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-80506484-998c-4dc6-9907-fc3dc7e784d2 req-8f0f7a6b-4569-440b-bf2d-5c41ec6542ef service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:19.473565 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-80506484-998c-4dc6-9907-fc3dc7e784d2 req-8f0f7a6b-4569-440b-bf2d-5c41ec6542ef service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:19.489098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-80506484-998c-4dc6-9907-fc3dc7e784d2 req-8f0f7a6b-4569-440b-bf2d-5c41ec6542ef service nova] Creating event network-vif-deleted:bd84b30a-cc10-459e-ab2e-bf61f225c610 for instance d0bedbd2-0142-4af2-a367-257352a283a5 on hv-cinder-84984 Sep 15 19:34:19.494917 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-80506484-998c-4dc6-9907-fc3dc7e784d2 req-8f0f7a6b-4569-440b-bf2d-5c41ec6542ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045275 Sep 15 19:34:19.495861 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 588/857] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:34:19.999157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-28c6297f-a4e4-4e4f-8d47-56ae7eec90f8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:20.000089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-28c6297f-a4e4-4e4f-8d47-56ae7eec90f8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:20.009026 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28c6297f-a4e4-4e4f-8d47-56ae7eec90f8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:20.012086 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28c6297f-a4e4-4e4f-8d47-56ae7eec90f8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:20.012086 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28c6297f-a4e4-4e4f-8d47-56ae7eec90f8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:20.012086 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28c6297f-a4e4-4e4f-8d47-56ae7eec90f8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:20.012086 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28c6297f-a4e4-4e4f-8d47-56ae7eec90f8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:20.012495 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28c6297f-a4e4-4e4f-8d47-56ae7eec90f8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:20.157836 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-28c6297f-a4e4-4e4f-8d47-56ae7eec90f8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:20.166815 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-28c6297f-a4e4-4e4f-8d47-56ae7eec90f8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:20.168392 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-28c6297f-a4e4-4e4f-8d47-56ae7eec90f8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:20.169654 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-28c6297f-a4e4-4e4f-8d47-56ae7eec90f8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1743 microversion: 2.20 time: 0.175418 Sep 15 19:34:20.170211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 589/858] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:19 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:34:20.280429 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:20.281846 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:20.287204 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:20.287719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:20.288157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:20.288855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:20.289309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:20.289728 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:20.334711 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:20.334711 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:20.334711 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:20.334711 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lazy-loading 'fault' on Instance uuid d0bedbd2-0142-4af2-a367-257352a283a5 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:34:20.379434 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbdd49e2fa64b428d957d9dcf1d6846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340975b28fc242b5bf4a3364fe702ad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:20.384854 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ff8bbc0e-3ffc-46a4-a610-d9d2cf791181 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 200 len: 1328 microversion: 2.1 time: 0.108288 Sep 15 19:34:20.385445 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 590/859] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:34:20 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:34:21.196967 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4497f7c0-4b40-4347-8d4c-d538ec521175 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:21.197624 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4497f7c0-4b40-4347-8d4c-d538ec521175 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:21.204721 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4497f7c0-4b40-4347-8d4c-d538ec521175 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:21.205443 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4497f7c0-4b40-4347-8d4c-d538ec521175 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:21.206070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4497f7c0-4b40-4347-8d4c-d538ec521175 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:21.207550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4497f7c0-4b40-4347-8d4c-d538ec521175 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:21.208038 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4497f7c0-4b40-4347-8d4c-d538ec521175 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:21.208463 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4497f7c0-4b40-4347-8d4c-d538ec521175 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:21.356932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4497f7c0-4b40-4347-8d4c-d538ec521175 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:21.367413 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4497f7c0-4b40-4347-8d4c-d538ec521175 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:21.370912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4497f7c0-4b40-4347-8d4c-d538ec521175 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:21.370912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4497f7c0-4b40-4347-8d4c-d538ec521175 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1743 microversion: 2.20 time: 0.177335 Sep 15 19:34:21.371310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 591/860] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:21 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:21.408417 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b53ea8ae-1472-49a5-9899-8968cc4c0cde tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:21.409041 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b53ea8ae-1472-49a5-9899-8968cc4c0cde tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:21.415592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b53ea8ae-1472-49a5-9899-8968cc4c0cde tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:21.416116 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b53ea8ae-1472-49a5-9899-8968cc4c0cde tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:21.416554 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b53ea8ae-1472-49a5-9899-8968cc4c0cde tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:21.417260 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b53ea8ae-1472-49a5-9899-8968cc4c0cde tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:21.417702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b53ea8ae-1472-49a5-9899-8968cc4c0cde tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:21.418124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b53ea8ae-1472-49a5-9899-8968cc4c0cde tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:21.433122 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-b53ea8ae-1472-49a5-9899-8968cc4c0cde tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] HTTP exception thrown: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b53ea8ae-1472-49a5-9899-8968cc4c0cde tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Request method failure captured: Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 HTTP/1.1 Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3zT6kDQ9Io6lHalRBgBJgcCiy22cNKVdKEP6Zrlj2oDNnS4DBn31E-3_IbiOcPAyZC3zWOQmlN-ZoWdEH9iu2VkV7zKiqSVx3kyVF6It3h4iqEzhkv_K36XLiifpCA_Gnsj306FZJ62uRpoZrBG6CzFxzOdfIkq4X2R6tot1oqH9Ew Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 340975b28fc242b5bf4a3364fe702ad4 Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:34:21.435066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:34:21.436780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_340975b28fc242b5bf4a3364fe702ad4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/340975b28fc242b5bf4a3364fe702ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/340975b28fc242b5bf4a3364fe702ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/340975b28fc242b5bf4a3364fe702ad4"}]}] Sep 15 19:34:21.436780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:21.436780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 340975b28fc242b5bf4a3364fe702ad4 Sep 15 19:34:21.436780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:21.436780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeTestJSON-820242980-project Sep 15 19:34:21.436780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:34:21.436780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:34:21.436780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: cfbdd49e2fa64b428d957d9dcf1d6846 Sep 15 19:34:21.436780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeTestJSON-820242980-project Sep 15 19:34:21.436780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:34:21.436780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:21.436780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'd0bedbd2-0142-4af2-a367-257352a283a5'} Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:34:21.438966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:21.440723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:21.442321 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b53ea8ae-1472-49a5-9899-8968cc4c0cde tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Returning 404 to user: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:34:21.442321 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b53ea8ae-1472-49a5-9899-8968cc4c0cde tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 404 len: 111 microversion: 2.1 time: 0.032484 Sep 15 19:34:21.442321 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 592/861] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:34:21 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:34:21.456730 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-45b71458-708f-408a-8ea6-8ecf646ae770 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '.version_select at 0x7f551eb65160>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:21.569695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-45b71458-708f-408a-8ea6-8ecf646ae770 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2005321195" status: 202 len: 0 microversion: 2.1 time: 0.125334 Sep 15 19:34:21.570272 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 593/862] 10.222.0.18 () {58 vars in 1221 bytes} [Thu Sep 15 19:34:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2005321195 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:34:22.404762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-673f1ef3-773f-4a15-9523-e6636532f5a6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:22.408339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-673f1ef3-773f-4a15-9523-e6636532f5a6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:22.421756 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-673f1ef3-773f-4a15-9523-e6636532f5a6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:22.423061 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-673f1ef3-773f-4a15-9523-e6636532f5a6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:22.424168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-673f1ef3-773f-4a15-9523-e6636532f5a6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:22.425753 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-673f1ef3-773f-4a15-9523-e6636532f5a6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:22.426779 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-673f1ef3-773f-4a15-9523-e6636532f5a6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:22.427800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-673f1ef3-773f-4a15-9523-e6636532f5a6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:22.651203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-673f1ef3-773f-4a15-9523-e6636532f5a6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:22.676859 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-673f1ef3-773f-4a15-9523-e6636532f5a6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:22.679753 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-673f1ef3-773f-4a15-9523-e6636532f5a6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:22.680082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-673f1ef3-773f-4a15-9523-e6636532f5a6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1738 microversion: 2.20 time: 0.284450 Sep 15 19:34:22.695678 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 594/863] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:22 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1738 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:23.727104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8783ef06-9838-460b-a7bc-55e2ac3086b6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:23.728545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8783ef06-9838-460b-a7bc-55e2ac3086b6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:23.743235 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8783ef06-9838-460b-a7bc-55e2ac3086b6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:23.744252 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8783ef06-9838-460b-a7bc-55e2ac3086b6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:23.744868 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8783ef06-9838-460b-a7bc-55e2ac3086b6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:23.747843 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8783ef06-9838-460b-a7bc-55e2ac3086b6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:23.749533 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8783ef06-9838-460b-a7bc-55e2ac3086b6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:23.749969 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8783ef06-9838-460b-a7bc-55e2ac3086b6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:24.005974 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8783ef06-9838-460b-a7bc-55e2ac3086b6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:24.016034 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8783ef06-9838-460b-a7bc-55e2ac3086b6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:24.017895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8783ef06-9838-460b-a7bc-55e2ac3086b6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:24.019265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8783ef06-9838-460b-a7bc-55e2ac3086b6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1738 microversion: 2.20 time: 0.303714 Sep 15 19:34:24.020355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 595/864] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:23 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:24.943850 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-520f6e68-b2d5-4517-81da-0cee213fe7b0 req-3619bf6c-cae9-478f-8830-de2470e0d6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4", "name": "network-vif-plugged", "status": "completed", "tag": "143ce322-19a2-43c5-83ec-ba67ce8ce7cc"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:34:24.971945 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-520f6e68-b2d5-4517-81da-0cee213fe7b0 req-3619bf6c-cae9-478f-8830-de2470e0d6be service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:24.972747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-520f6e68-b2d5-4517-81da-0cee213fe7b0 req-3619bf6c-cae9-478f-8830-de2470e0d6be service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:24.973344 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-520f6e68-b2d5-4517-81da-0cee213fe7b0 req-3619bf6c-cae9-478f-8830-de2470e0d6be service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:24.988996 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-520f6e68-b2d5-4517-81da-0cee213fe7b0 req-3619bf6c-cae9-478f-8830-de2470e0d6be service nova] Creating event network-vif-plugged:143ce322-19a2-43c5-83ec-ba67ce8ce7cc for instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 on hv-cinder-84984 Sep 15 19:34:24.995049 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-520f6e68-b2d5-4517-81da-0cee213fe7b0 req-3619bf6c-cae9-478f-8830-de2470e0d6be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064545 Sep 15 19:34:24.995582 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 596/865] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:34:25.065579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0be43c70-99e3-4466-b1e1-61d3977c2a96 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:25.066770 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0be43c70-99e3-4466-b1e1-61d3977c2a96 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:25.075199 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0be43c70-99e3-4466-b1e1-61d3977c2a96 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:25.079394 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0be43c70-99e3-4466-b1e1-61d3977c2a96 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:25.079394 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0be43c70-99e3-4466-b1e1-61d3977c2a96 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:25.079394 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0be43c70-99e3-4466-b1e1-61d3977c2a96 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:25.079394 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0be43c70-99e3-4466-b1e1-61d3977c2a96 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:25.079771 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0be43c70-99e3-4466-b1e1-61d3977c2a96 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:25.258875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0be43c70-99e3-4466-b1e1-61d3977c2a96 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:25.269426 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0be43c70-99e3-4466-b1e1-61d3977c2a96 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:25.271618 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0be43c70-99e3-4466-b1e1-61d3977c2a96 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:25.274595 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0be43c70-99e3-4466-b1e1-61d3977c2a96 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1738 microversion: 2.20 time: 0.215580 Sep 15 19:34:25.291576 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 597/866] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:25 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:25.377489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ab2e1892-d13a-48c9-a997-fdd5f79d4285 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:25.378122 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ab2e1892-d13a-48c9-a997-fdd5f79d4285 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:25.385970 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab2e1892-d13a-48c9-a997-fdd5f79d4285 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:25.386601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab2e1892-d13a-48c9-a997-fdd5f79d4285 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:25.387131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab2e1892-d13a-48c9-a997-fdd5f79d4285 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:25.387999 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab2e1892-d13a-48c9-a997-fdd5f79d4285 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:25.389297 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab2e1892-d13a-48c9-a997-fdd5f79d4285 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:25.389297 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ab2e1892-d13a-48c9-a997-fdd5f79d4285 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:25.407989 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-ab2e1892-d13a-48c9-a997-fdd5f79d4285 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] HTTP exception thrown: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ab2e1892-d13a-48c9-a997-fdd5f79d4285 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Request method failure captured: Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 HTTP/1.1 Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3zT6kDQ9Io6lHalRBgBJgcCiy22cNKVdKEP6Zrlj2oDNnS4DBn31E-3_IbiOcPAyZC3zWOQmlN-ZoWdEH9iu2VkV7zKiqSVx3kyVF6It3h4iqEzhkv_K36XLiifpCA_Gnsj306FZJ62uRpoZrBG6CzFxzOdfIkq4X2R6tot1oqH9Ew Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 340975b28fc242b5bf4a3364fe702ad4 Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:34:25.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:34:25.412131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_340975b28fc242b5bf4a3364fe702ad4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/340975b28fc242b5bf4a3364fe702ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/340975b28fc242b5bf4a3364fe702ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/340975b28fc242b5bf4a3364fe702ad4"}]}] Sep 15 19:34:25.412131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:25.412131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 340975b28fc242b5bf4a3364fe702ad4 Sep 15 19:34:25.412131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:25.412131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeTestJSON-820242980-project Sep 15 19:34:25.412131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:34:25.412131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:34:25.412131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: cfbdd49e2fa64b428d957d9dcf1d6846 Sep 15 19:34:25.412131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeTestJSON-820242980-project Sep 15 19:34:25.412131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:34:25.412131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:25.412131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'd0bedbd2-0142-4af2-a367-257352a283a5'} Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:34:25.413765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:25.416680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:25.418805 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ab2e1892-d13a-48c9-a997-fdd5f79d4285 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Returning 404 to user: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:34:25.418805 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ab2e1892-d13a-48c9-a997-fdd5f79d4285 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 404 len: 111 microversion: 2.1 time: 0.039987 Sep 15 19:34:25.418805 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 598/867] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:34:25 2022] DELETE /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:34:25.422864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6b3e1189-7b54-47c1-8706-bd2e053a99f6 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:25.423475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6b3e1189-7b54-47c1-8706-bd2e053a99f6 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: d0bedbd2-0142-4af2-a367-257352a283a5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:25.430654 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b3e1189-7b54-47c1-8706-bd2e053a99f6 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:25.431200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b3e1189-7b54-47c1-8706-bd2e053a99f6 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:25.432158 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b3e1189-7b54-47c1-8706-bd2e053a99f6 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:25.432644 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b3e1189-7b54-47c1-8706-bd2e053a99f6 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:25.433193 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b3e1189-7b54-47c1-8706-bd2e053a99f6 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:25.433659 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b3e1189-7b54-47c1-8706-bd2e053a99f6 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:25.451763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-6b3e1189-7b54-47c1-8706-bd2e053a99f6 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] HTTP exception thrown: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6b3e1189-7b54-47c1-8706-bd2e053a99f6 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Request method failure captured: Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 HTTP/1.1 Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3zT6kDQ9Io6lHalRBgBJgcCiy22cNKVdKEP6Zrlj2oDNnS4DBn31E-3_IbiOcPAyZC3zWOQmlN-ZoWdEH9iu2VkV7zKiqSVx3kyVF6It3h4iqEzhkv_K36XLiifpCA_Gnsj306FZJ62uRpoZrBG6CzFxzOdfIkq4X2R6tot1oqH9Ew Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 340975b28fc242b5bf4a3364fe702ad4 Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:34:25.454471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:34:25.456885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_340975b28fc242b5bf4a3364fe702ad4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/340975b28fc242b5bf4a3364fe702ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/340975b28fc242b5bf4a3364fe702ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/340975b28fc242b5bf4a3364fe702ad4"}]}] Sep 15 19:34:25.456885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:25.456885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 340975b28fc242b5bf4a3364fe702ad4 Sep 15 19:34:25.456885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:25.456885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeTestJSON-820242980-project Sep 15 19:34:25.456885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:34:25.456885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:34:25.456885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: cfbdd49e2fa64b428d957d9dcf1d6846 Sep 15 19:34:25.456885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeTestJSON-820242980-project Sep 15 19:34:25.456885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:34:25.456885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:25.456885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'd0bedbd2-0142-4af2-a367-257352a283a5'} Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:34:25.458009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. Sep 15 19:34:25.459786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:25.461124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6b3e1189-7b54-47c1-8706-bd2e053a99f6 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Returning 404 to user: Instance d0bedbd2-0142-4af2-a367-257352a283a5 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:34:25.461124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6b3e1189-7b54-47c1-8706-bd2e053a99f6 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5" status: 404 len: 111 microversion: 2.1 time: 0.037460 Sep 15 19:34:25.461124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 599/868] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:34:25 2022] GET /compute/v2.1/servers/d0bedbd2-0142-4af2-a367-257352a283a5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:34:26.307326 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-83326c31-1a1c-4f1c-836a-e6767e471f3f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:26.316660 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-83326c31-1a1c-4f1c-836a-e6767e471f3f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:26.327807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-83326c31-1a1c-4f1c-836a-e6767e471f3f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:26.328794 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-83326c31-1a1c-4f1c-836a-e6767e471f3f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:26.329377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-83326c31-1a1c-4f1c-836a-e6767e471f3f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:26.329977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-83326c31-1a1c-4f1c-836a-e6767e471f3f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:26.330419 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-83326c31-1a1c-4f1c-836a-e6767e471f3f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:26.330841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-83326c31-1a1c-4f1c-836a-e6767e471f3f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:26.535854 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-83326c31-1a1c-4f1c-836a-e6767e471f3f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:26.556178 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-83326c31-1a1c-4f1c-836a-e6767e471f3f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:26.559140 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-83326c31-1a1c-4f1c-836a-e6767e471f3f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:26.561409 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-83326c31-1a1c-4f1c-836a-e6767e471f3f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1738 microversion: 2.20 time: 0.261415 Sep 15 19:34:26.562947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 600/869] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:26 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:27.179179 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f4d72f31-301c-44dc-a76b-400aee8f6b17 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:27.179713 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f4d72f31-301c-44dc-a76b-400aee8f6b17 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:27.186391 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4d72f31-301c-44dc-a76b-400aee8f6b17 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:27.187835 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4d72f31-301c-44dc-a76b-400aee8f6b17 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:27.190259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4d72f31-301c-44dc-a76b-400aee8f6b17 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:27.190259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4d72f31-301c-44dc-a76b-400aee8f6b17 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:27.190259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4d72f31-301c-44dc-a76b-400aee8f6b17 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:27.190259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4d72f31-301c-44dc-a76b-400aee8f6b17 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:27.206661 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-f4d72f31-301c-44dc-a76b-400aee8f6b17 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] HTTP exception thrown: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f4d72f31-301c-44dc-a76b-400aee8f6b17 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Request method failure captured: Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f HTTP/1.1 Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3zT6kDQ9Io6lHalRBgBJgcCiy22cNKVdKEP6Zrlj2oDNnS4DBn31E-3_IbiOcPAyZC3zWOQmlN-ZoWdEH9iu2VkV7zKiqSVx3kyVF6It3h4iqEzhkv_K36XLiifpCA_Gnsj306FZJ62uRpoZrBG6CzFxzOdfIkq4X2R6tot1oqH9Ew Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 340975b28fc242b5bf4a3364fe702ad4 Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:34:27.208163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:34:27.211549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_340975b28fc242b5bf4a3364fe702ad4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/340975b28fc242b5bf4a3364fe702ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/340975b28fc242b5bf4a3364fe702ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/340975b28fc242b5bf4a3364fe702ad4"}]}] Sep 15 19:34:27.211549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:27.211549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 340975b28fc242b5bf4a3364fe702ad4 Sep 15 19:34:27.211549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:27.211549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeTestJSON-820242980-project Sep 15 19:34:27.211549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:34:27.211549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:34:27.211549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: cfbdd49e2fa64b428d957d9dcf1d6846 Sep 15 19:34:27.211549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeTestJSON-820242980-project Sep 15 19:34:27.211549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:34:27.211549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:34:27.211549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '8ddcd684-503e-4123-9078-c4821c63519f'} Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:34:27.212489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:34:27.213977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:27.215610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f4d72f31-301c-44dc-a76b-400aee8f6b17 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Returning 404 to user: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:34:27.215610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f4d72f31-301c-44dc-a76b-400aee8f6b17 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 404 len: 111 microversion: 2.1 time: 0.034386 Sep 15 19:34:27.215610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 601/870] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:34:27 2022] DELETE /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:34:27.221287 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-16e44307-ace7-405d-82dd-d53fe65a6893 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:27.222311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-16e44307-ace7-405d-82dd-d53fe65a6893 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] [instance: 8ddcd684-503e-4123-9078-c4821c63519f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:27.232154 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16e44307-ace7-405d-82dd-d53fe65a6893 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:27.232644 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16e44307-ace7-405d-82dd-d53fe65a6893 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:27.233080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16e44307-ace7-405d-82dd-d53fe65a6893 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:27.233818 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16e44307-ace7-405d-82dd-d53fe65a6893 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:27.234261 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16e44307-ace7-405d-82dd-d53fe65a6893 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:27.234714 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-16e44307-ace7-405d-82dd-d53fe65a6893 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:27.252952 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-16e44307-ace7-405d-82dd-d53fe65a6893 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] HTTP exception thrown: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-16e44307-ace7-405d-82dd-d53fe65a6893 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Request method failure captured: Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f HTTP/1.1 Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI3zT6kDQ9Io6lHalRBgBJgcCiy22cNKVdKEP6Zrlj2oDNnS4DBn31E-3_IbiOcPAyZC3zWOQmlN-ZoWdEH9iu2VkV7zKiqSVx3kyVF6It3h4iqEzhkv_K36XLiifpCA_Gnsj306FZJ62uRpoZrBG6CzFxzOdfIkq4X2R6tot1oqH9Ew Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 340975b28fc242b5bf4a3364fe702ad4 Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:34:27.256115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:34:27.258098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_340975b28fc242b5bf4a3364fe702ad4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/340975b28fc242b5bf4a3364fe702ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/340975b28fc242b5bf4a3364fe702ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/340975b28fc242b5bf4a3364fe702ad4"}]}] Sep 15 19:34:27.258098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:27.258098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 340975b28fc242b5bf4a3364fe702ad4 Sep 15 19:34:27.258098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-820242980 Sep 15 19:34:27.258098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeTestJSON-820242980-project Sep 15 19:34:27.258098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:34:27.258098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:34:27.258098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: cfbdd49e2fa64b428d957d9dcf1d6846 Sep 15 19:34:27.258098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeTestJSON-820242980-project Sep 15 19:34:27.258098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:34:27.258098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:34:27.258098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '8ddcd684-503e-4123-9078-c4821c63519f'} Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:34:27.258950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. Sep 15 19:34:27.260206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:27.262412 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-16e44307-ace7-405d-82dd-d53fe65a6893 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] Returning 404 to user: Instance 8ddcd684-503e-4123-9078-c4821c63519f could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:34:27.262412 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-16e44307-ace7-405d-82dd-d53fe65a6893 tempest-AttachVolumeTestJSON-820242980 tempest-AttachVolumeTestJSON-820242980-project] 10.222.0.18 "GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f" status: 404 len: 111 microversion: 2.1 time: 0.042511 Sep 15 19:34:27.262412 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 602/871] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:34:27 2022] GET /compute/v2.1/servers/8ddcd684-503e-4123-9078-c4821c63519f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:34:27.602291 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8ed5d2ad-099a-476d-8449-e13ad2c861b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:27.603822 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8ed5d2ad-099a-476d-8449-e13ad2c861b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:27.611494 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ed5d2ad-099a-476d-8449-e13ad2c861b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:27.612364 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ed5d2ad-099a-476d-8449-e13ad2c861b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:27.613023 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ed5d2ad-099a-476d-8449-e13ad2c861b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:27.613965 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ed5d2ad-099a-476d-8449-e13ad2c861b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:27.615100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ed5d2ad-099a-476d-8449-e13ad2c861b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:27.615803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ed5d2ad-099a-476d-8449-e13ad2c861b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:27.800179 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8ed5d2ad-099a-476d-8449-e13ad2c861b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:27.814935 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8ed5d2ad-099a-476d-8449-e13ad2c861b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:27.818597 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8ed5d2ad-099a-476d-8449-e13ad2c861b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:27.822544 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8ed5d2ad-099a-476d-8449-e13ad2c861b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1738 microversion: 2.20 time: 0.224165 Sep 15 19:34:27.823871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 603/872] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:27 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:28.859928 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-18215e80-3c7d-4568-9540-f8f275f394c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:28.862315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-18215e80-3c7d-4568-9540-f8f275f394c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:28.876388 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18215e80-3c7d-4568-9540-f8f275f394c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:28.887103 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18215e80-3c7d-4568-9540-f8f275f394c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:28.888221 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18215e80-3c7d-4568-9540-f8f275f394c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:28.889445 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18215e80-3c7d-4568-9540-f8f275f394c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:28.890859 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18215e80-3c7d-4568-9540-f8f275f394c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:28.891505 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-18215e80-3c7d-4568-9540-f8f275f394c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:29.082833 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-18215e80-3c7d-4568-9540-f8f275f394c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:29.119550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-18215e80-3c7d-4568-9540-f8f275f394c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:29.119550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-18215e80-3c7d-4568-9540-f8f275f394c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:29.119550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-18215e80-3c7d-4568-9540-f8f275f394c4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1738 microversion: 2.20 time: 0.253214 Sep 15 19:34:29.120390 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 604/873] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:28 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:30.139002 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d02f7e89-2079-4991-bf7f-42470989170e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:30.139795 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d02f7e89-2079-4991-bf7f-42470989170e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:30.151142 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d02f7e89-2079-4991-bf7f-42470989170e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:30.151816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d02f7e89-2079-4991-bf7f-42470989170e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:30.153042 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d02f7e89-2079-4991-bf7f-42470989170e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:30.156125 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d02f7e89-2079-4991-bf7f-42470989170e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:30.159149 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d02f7e89-2079-4991-bf7f-42470989170e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:30.159905 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d02f7e89-2079-4991-bf7f-42470989170e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:30.336942 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d02f7e89-2079-4991-bf7f-42470989170e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:30.352063 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d02f7e89-2079-4991-bf7f-42470989170e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:30.359959 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d02f7e89-2079-4991-bf7f-42470989170e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:30.361723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d02f7e89-2079-4991-bf7f-42470989170e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1738 microversion: 2.20 time: 0.227398 Sep 15 19:34:30.377350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 605/874] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:30 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:31.389320 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2a498df9-5034-45ef-b388-06782a92a3fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:31.390208 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2a498df9-5034-45ef-b388-06782a92a3fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:31.398727 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a498df9-5034-45ef-b388-06782a92a3fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:31.399892 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a498df9-5034-45ef-b388-06782a92a3fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:31.400355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a498df9-5034-45ef-b388-06782a92a3fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:31.401176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a498df9-5034-45ef-b388-06782a92a3fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:31.401819 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a498df9-5034-45ef-b388-06782a92a3fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:31.402553 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a498df9-5034-45ef-b388-06782a92a3fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:31.597763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2a498df9-5034-45ef-b388-06782a92a3fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:31.612231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2a498df9-5034-45ef-b388-06782a92a3fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:31.618936 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2a498df9-5034-45ef-b388-06782a92a3fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:31.618936 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2a498df9-5034-45ef-b388-06782a92a3fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1738 microversion: 2.20 time: 0.230951 Sep 15 19:34:31.633214 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 606/875] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:31 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:32.644167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b52f8e62-5e6a-4f01-b01b-a1352cca8e23 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:32.645515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b52f8e62-5e6a-4f01-b01b-a1352cca8e23 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:32.653531 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b52f8e62-5e6a-4f01-b01b-a1352cca8e23 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:32.654407 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b52f8e62-5e6a-4f01-b01b-a1352cca8e23 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:32.655080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b52f8e62-5e6a-4f01-b01b-a1352cca8e23 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:32.656269 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b52f8e62-5e6a-4f01-b01b-a1352cca8e23 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:32.657046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b52f8e62-5e6a-4f01-b01b-a1352cca8e23 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:32.657563 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b52f8e62-5e6a-4f01-b01b-a1352cca8e23 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:32.891085 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b52f8e62-5e6a-4f01-b01b-a1352cca8e23 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:32.907002 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b52f8e62-5e6a-4f01-b01b-a1352cca8e23 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:32.909183 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b52f8e62-5e6a-4f01-b01b-a1352cca8e23 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:32.910787 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b52f8e62-5e6a-4f01-b01b-a1352cca8e23 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1738 microversion: 2.20 time: 0.271889 Sep 15 19:34:32.919700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 607/876] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:32 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:33.958502 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0c10dca8-4ba9-4b48-a303-824a3ba693de tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:33.959800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0c10dca8-4ba9-4b48-a303-824a3ba693de tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:33.966547 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c10dca8-4ba9-4b48-a303-824a3ba693de tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:33.967024 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c10dca8-4ba9-4b48-a303-824a3ba693de tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:33.967790 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c10dca8-4ba9-4b48-a303-824a3ba693de tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:33.968535 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c10dca8-4ba9-4b48-a303-824a3ba693de tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:33.968997 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c10dca8-4ba9-4b48-a303-824a3ba693de tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:33.969797 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c10dca8-4ba9-4b48-a303-824a3ba693de tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:34.169581 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0c10dca8-4ba9-4b48-a303-824a3ba693de tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:34.175299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:34:34.180896 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0c10dca8-4ba9-4b48-a303-824a3ba693de tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:34.183082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0c10dca8-4ba9-4b48-a303-824a3ba693de tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:34.184674 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0c10dca8-4ba9-4b48-a303-824a3ba693de tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1738 microversion: 2.20 time: 0.230610 Sep 15 19:34:34.185684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 608/877] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:33 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:35.223083 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-19718345-d6ba-43d2-a475-5c1752ee6749 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:35.223966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-19718345-d6ba-43d2-a475-5c1752ee6749 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:35.232117 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19718345-d6ba-43d2-a475-5c1752ee6749 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:35.232652 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19718345-d6ba-43d2-a475-5c1752ee6749 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:35.233062 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19718345-d6ba-43d2-a475-5c1752ee6749 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:35.233825 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19718345-d6ba-43d2-a475-5c1752ee6749 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:35.234362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19718345-d6ba-43d2-a475-5c1752ee6749 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:35.234781 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19718345-d6ba-43d2-a475-5c1752ee6749 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:35.379656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-19718345-d6ba-43d2-a475-5c1752ee6749 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:35.391571 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-19718345-d6ba-43d2-a475-5c1752ee6749 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:35.394185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-19718345-d6ba-43d2-a475-5c1752ee6749 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:35.396073 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-19718345-d6ba-43d2-a475-5c1752ee6749 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1738 microversion: 2.20 time: 0.179151 Sep 15 19:34:35.396977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 609/878] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:35 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:34:35.549520 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c6eea4b0-ae23-48bd-9faa-10ad16dff0a6 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Action: 'create', calling method: .version_select at 0x7f551ec038b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1562182760"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:34:36.300502 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c6eea4b0-ae23-48bd-9faa-10ad16dff0a6 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.895642 Sep 15 19:34:36.301164 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 610/879] 10.222.0.18 () {60 vars in 1155 bytes} [Thu Sep 15 19:34:35 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 904 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 15 19:34:36.316776 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-df921dbf-7406-41ec-ab71-bf96cd2c5cb2 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551ebcb940>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:36.372126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-df921dbf-7406-41ec-ab71-bf96cd2c5cb2 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df" status: 200 len: 345 microversion: 2.1 time: 0.061268 Sep 15 19:34:36.373404 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 611/880] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:34:36 2022] GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:34:36.436256 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d150dae8-6f98-43e7-a25c-35a1bf627e4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:36.437388 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d150dae8-6f98-43e7-a25c-35a1bf627e4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:36.444127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d150dae8-6f98-43e7-a25c-35a1bf627e4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:36.444604 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d150dae8-6f98-43e7-a25c-35a1bf627e4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:36.445032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d150dae8-6f98-43e7-a25c-35a1bf627e4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:36.445726 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d150dae8-6f98-43e7-a25c-35a1bf627e4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:36.446166 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d150dae8-6f98-43e7-a25c-35a1bf627e4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:36.446584 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d150dae8-6f98-43e7-a25c-35a1bf627e4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:36.590571 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d150dae8-6f98-43e7-a25c-35a1bf627e4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:36.599372 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d150dae8-6f98-43e7-a25c-35a1bf627e4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:36.600868 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d150dae8-6f98-43e7-a25c-35a1bf627e4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:36.602037 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d150dae8-6f98-43e7-a25c-35a1bf627e4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1738 microversion: 2.20 time: 0.170136 Sep 15 19:34:36.602708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 612/881] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:36 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:37.388438 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-14da242a-3283-48ee-aa98-9c05151d6ee4 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551ebcbe50>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:37.438736 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-14da242a-3283-48ee-aa98-9c05151d6ee4 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df" status: 200 len: 345 microversion: 2.1 time: 0.054044 Sep 15 19:34:37.439516 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 613/882] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:34:37 2022] GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:34:37.628907 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-96fe80a3-6219-4008-bcb0-76b85c8137e8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:37.629515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-96fe80a3-6219-4008-bcb0-76b85c8137e8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:37.635536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96fe80a3-6219-4008-bcb0-76b85c8137e8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:37.636076 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96fe80a3-6219-4008-bcb0-76b85c8137e8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:37.636517 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96fe80a3-6219-4008-bcb0-76b85c8137e8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:37.637213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96fe80a3-6219-4008-bcb0-76b85c8137e8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:37.637664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96fe80a3-6219-4008-bcb0-76b85c8137e8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:37.638100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96fe80a3-6219-4008-bcb0-76b85c8137e8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:37.770390 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-96fe80a3-6219-4008-bcb0-76b85c8137e8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:37.778694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-96fe80a3-6219-4008-bcb0-76b85c8137e8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:37.780172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-96fe80a3-6219-4008-bcb0-76b85c8137e8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:37.781361 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-96fe80a3-6219-4008-bcb0-76b85c8137e8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1738 microversion: 2.20 time: 0.156994 Sep 15 19:34:37.781918 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 614/883] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:37 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:38.454686 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5dd877bb-baa5-4007-b8bb-e990aec9cfa4 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551eaad1f0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:38.501113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5dd877bb-baa5-4007-b8bb-e990aec9cfa4 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df" status: 200 len: 346 microversion: 2.1 time: 0.050886 Sep 15 19:34:38.501644 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 615/884] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:34:38 2022] GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:34:38.514291 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6ae83cf8-4eab-4688-9e8b-864393c86df8 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Action: 'create', calling method: .version_select at 0x7f551ec035e0>, body: {"snapshot": {"volume_id": "eac236fc-6e34-4f98-a589-add0742ac7df", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-832056529"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:34:38.998377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6ae83cf8-4eab-4688-9e8b-864393c86df8 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.487605 Sep 15 19:34:38.998955 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 616/885] 10.222.0.18 () {60 vars in 1162 bytes} [Thu Sep 15 19:34:38 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:34:39.004546 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1c234697-9a32-4d8f-8377-0f12ee7e8bd6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:39.005564 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1c234697-9a32-4d8f-8377-0f12ee7e8bd6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:39.009249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:34:39.013251 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c234697-9a32-4d8f-8377-0f12ee7e8bd6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:39.013804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c234697-9a32-4d8f-8377-0f12ee7e8bd6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:39.014305 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c234697-9a32-4d8f-8377-0f12ee7e8bd6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:39.015227 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c234697-9a32-4d8f-8377-0f12ee7e8bd6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:39.015771 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c234697-9a32-4d8f-8377-0f12ee7e8bd6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:39.016190 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c234697-9a32-4d8f-8377-0f12ee7e8bd6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:39.143655 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1c234697-9a32-4d8f-8377-0f12ee7e8bd6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:39.151945 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1c234697-9a32-4d8f-8377-0f12ee7e8bd6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:39.153422 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1c234697-9a32-4d8f-8377-0f12ee7e8bd6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:39.154586 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1c234697-9a32-4d8f-8377-0f12ee7e8bd6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1720 microversion: 2.20 time: 0.153920 Sep 15 19:34:39.155147 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 617/886] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:38 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:34:39.160295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-04a576a1-18c1-474f-8d7c-0c904e2333af tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551ec030d0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:39.191282 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-04a576a1-18c1-474f-8d7c-0c904e2333af tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a" status: 200 len: 286 microversion: 2.1 time: 0.034492 Sep 15 19:34:39.191895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 618/887] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 15 19:34:39 2022] GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:34:39.202863 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bef945d3-ccfa-42e9-acc7-a2c44b2b38bc tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551eaadca0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:39.234699 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bef945d3-ccfa-42e9-acc7-a2c44b2b38bc tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034729 Sep 15 19:34:39.235258 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 619/888] 10.222.0.18 () {58 vars in 1140 bytes} [Thu Sep 15 19:34:39 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:34:39.246322 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-200b52f7-a181-4435-a983-fea46ace6379 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551ea7e160>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:39.276876 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-200b52f7-a181-4435-a983-fea46ace6379 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a" status: 200 len: 286 microversion: 2.1 time: 0.034213 Sep 15 19:34:39.277494 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 620/889] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 15 19:34:39 2022] GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:34:40.182183 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-07d6fab8-26f8-4bf6-a78b-da2874c8640c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:40.182872 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-07d6fab8-26f8-4bf6-a78b-da2874c8640c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:40.189790 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07d6fab8-26f8-4bf6-a78b-da2874c8640c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:40.190261 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07d6fab8-26f8-4bf6-a78b-da2874c8640c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:40.190692 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07d6fab8-26f8-4bf6-a78b-da2874c8640c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:40.191376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07d6fab8-26f8-4bf6-a78b-da2874c8640c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:40.191851 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07d6fab8-26f8-4bf6-a78b-da2874c8640c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:40.192350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07d6fab8-26f8-4bf6-a78b-da2874c8640c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:40.321355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-07d6fab8-26f8-4bf6-a78b-da2874c8640c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:40.329526 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-07d6fab8-26f8-4bf6-a78b-da2874c8640c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:40.330989 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-07d6fab8-26f8-4bf6-a78b-da2874c8640c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:40.332242 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-07d6fab8-26f8-4bf6-a78b-da2874c8640c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1720 microversion: 2.20 time: 0.154561 Sep 15 19:34:40.332872 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 621/890] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:40 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:40.343761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7dce0ffb-446a-4fa0-9410-c2e4ecbe8891 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551ea011f0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:40.367304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7dce0ffb-446a-4fa0-9410-c2e4ecbe8891 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a" status: 200 len: 286 microversion: 2.1 time: 0.033386 Sep 15 19:34:40.367919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 622/891] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 15 19:34:40 2022] GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:34:41.358062 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1bf76fff-0495-4782-a16e-4d286bd9426d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:41.358722 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1bf76fff-0495-4782-a16e-4d286bd9426d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:41.365387 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1bf76fff-0495-4782-a16e-4d286bd9426d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:41.365866 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1bf76fff-0495-4782-a16e-4d286bd9426d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:41.366297 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1bf76fff-0495-4782-a16e-4d286bd9426d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:41.366984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1bf76fff-0495-4782-a16e-4d286bd9426d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:41.367430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1bf76fff-0495-4782-a16e-4d286bd9426d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:41.367877 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1bf76fff-0495-4782-a16e-4d286bd9426d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:41.499371 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1bf76fff-0495-4782-a16e-4d286bd9426d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:41.508256 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1bf76fff-0495-4782-a16e-4d286bd9426d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:41.509719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1bf76fff-0495-4782-a16e-4d286bd9426d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:41.513708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1bf76fff-0495-4782-a16e-4d286bd9426d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1720 microversion: 2.20 time: 0.157457 Sep 15 19:34:41.513708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 623/892] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:41 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:34:41.516569 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7663ddfd-9cd4-42e4-a41a-f1817e7d7063 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551ec038b0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:41.545974 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7663ddfd-9cd4-42e4-a41a-f1817e7d7063 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a" status: 200 len: 286 microversion: 2.1 time: 0.033476 Sep 15 19:34:41.546543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 624/893] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 15 19:34:41 2022] GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:34:42.537920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4256e8d4-cad9-47f2-a6f5-faf714de466c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:42.538534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4256e8d4-cad9-47f2-a6f5-faf714de466c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:42.544703 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4256e8d4-cad9-47f2-a6f5-faf714de466c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:42.545183 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4256e8d4-cad9-47f2-a6f5-faf714de466c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:42.545620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4256e8d4-cad9-47f2-a6f5-faf714de466c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:42.546375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4256e8d4-cad9-47f2-a6f5-faf714de466c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:42.546827 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4256e8d4-cad9-47f2-a6f5-faf714de466c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:42.547270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4256e8d4-cad9-47f2-a6f5-faf714de466c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:42.680656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4256e8d4-cad9-47f2-a6f5-faf714de466c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:42.689125 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4256e8d4-cad9-47f2-a6f5-faf714de466c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:42.690567 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4256e8d4-cad9-47f2-a6f5-faf714de466c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:42.691899 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4256e8d4-cad9-47f2-a6f5-faf714de466c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1720 microversion: 2.20 time: 0.158403 Sep 15 19:34:42.692453 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 625/894] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:42 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:42.696833 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-97958492-78a0-48a8-a7de-afc27140a352 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551ea019d0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:42.727610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-97958492-78a0-48a8-a7de-afc27140a352 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a" status: 200 len: 286 microversion: 2.1 time: 0.034136 Sep 15 19:34:42.728257 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 626/895] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 15 19:34:42 2022] GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:34:43.615679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-acc1c7d8-d9f3-497f-9839-1dccc2b755e8 req-3ee227ef-b417-4f7a-98ee-011838ecc185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4", "name": "network-vif-unplugged", "status": "completed", "tag": "143ce322-19a2-43c5-83ec-ba67ce8ce7cc"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:34:43.628533 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-acc1c7d8-d9f3-497f-9839-1dccc2b755e8 req-3ee227ef-b417-4f7a-98ee-011838ecc185 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:43.629191 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-acc1c7d8-d9f3-497f-9839-1dccc2b755e8 req-3ee227ef-b417-4f7a-98ee-011838ecc185 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:43.629681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-acc1c7d8-d9f3-497f-9839-1dccc2b755e8 req-3ee227ef-b417-4f7a-98ee-011838ecc185 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:43.640180 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-acc1c7d8-d9f3-497f-9839-1dccc2b755e8 req-3ee227ef-b417-4f7a-98ee-011838ecc185 service nova] Creating event network-vif-unplugged:143ce322-19a2-43c5-83ec-ba67ce8ce7cc for instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 on hv-cinder-84984 Sep 15 19:34:43.645597 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-acc1c7d8-d9f3-497f-9839-1dccc2b755e8 req-3ee227ef-b417-4f7a-98ee-011838ecc185 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034376 Sep 15 19:34:43.646292 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 627/896] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:34:43.718636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f991642a-9745-4780-ba2c-af58449d1b16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:43.720123 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f991642a-9745-4780-ba2c-af58449d1b16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:43.726430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f991642a-9745-4780-ba2c-af58449d1b16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:43.726910 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f991642a-9745-4780-ba2c-af58449d1b16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:43.727341 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f991642a-9745-4780-ba2c-af58449d1b16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:43.728067 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f991642a-9745-4780-ba2c-af58449d1b16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:43.728517 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f991642a-9745-4780-ba2c-af58449d1b16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:43.728939 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f991642a-9745-4780-ba2c-af58449d1b16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:43.861700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f991642a-9745-4780-ba2c-af58449d1b16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:43.871933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f991642a-9745-4780-ba2c-af58449d1b16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:43.873476 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f991642a-9745-4780-ba2c-af58449d1b16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:43.874641 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f991642a-9745-4780-ba2c-af58449d1b16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1720 microversion: 2.20 time: 0.160500 Sep 15 19:34:43.875216 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 628/897] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:43 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:43.879978 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-41292599-f0c7-4a19-9381-9ab0e09bb5ac tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551eb72e50>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:43.910731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-41292599-f0c7-4a19-9381-9ab0e09bb5ac tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a" status: 200 len: 286 microversion: 2.1 time: 0.034294 Sep 15 19:34:43.911297 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 629/898] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 15 19:34:43 2022] GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:34:44.900221 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f878f9b4-47a4-42f2-9a33-0f9804d8629c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:44.900973 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f878f9b4-47a4-42f2-9a33-0f9804d8629c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:44.908798 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f878f9b4-47a4-42f2-9a33-0f9804d8629c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:44.909289 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f878f9b4-47a4-42f2-9a33-0f9804d8629c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:44.909733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f878f9b4-47a4-42f2-9a33-0f9804d8629c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:44.910443 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f878f9b4-47a4-42f2-9a33-0f9804d8629c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:44.910933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f878f9b4-47a4-42f2-9a33-0f9804d8629c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:44.911362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f878f9b4-47a4-42f2-9a33-0f9804d8629c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:45.046475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f878f9b4-47a4-42f2-9a33-0f9804d8629c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:45.055978 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f878f9b4-47a4-42f2-9a33-0f9804d8629c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:45.057512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f878f9b4-47a4-42f2-9a33-0f9804d8629c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:45.058720 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f878f9b4-47a4-42f2-9a33-0f9804d8629c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1720 microversion: 2.20 time: 0.163260 Sep 15 19:34:45.059280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 630/899] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:44 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:45.064675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-98999955-055d-424c-b20f-ea596573f0e8 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551ec4aee0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:45.095903 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-98999955-055d-424c-b20f-ea596573f0e8 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a" status: 200 len: 287 microversion: 2.1 time: 0.035357 Sep 15 19:34:45.096495 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 631/900] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 15 19:34:45 2022] GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:34:45.107746 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-56b1a56a-1cbc-42e8-ae48-c3c4c52da7db tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551eb724c0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:45.235837 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-56b1a56a-1cbc-42e8-ae48-c3c4c52da7db tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a" status: 202 len: 0 microversion: 2.1 time: 0.131701 Sep 15 19:34:45.236417 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 632/901] 10.222.0.18 () {58 vars in 1254 bytes} [Thu Sep 15 19:34:45 2022] DELETE /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 19:34:45.244825 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-87542ec5-8747-4248-bced-c3f2a3866104 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551e9c1160>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:45.276827 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-87542ec5-8747-4248-bced-c3f2a3866104 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a" status: 200 len: 286 microversion: 2.1 time: 0.035316 Sep 15 19:34:45.277022 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 633/902] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 15 19:34:45 2022] GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:34:46.086439 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c427536b-aefa-4e5a-b2b5-d6fdd878f6f4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:46.087135 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c427536b-aefa-4e5a-b2b5-d6fdd878f6f4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:46.093064 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c427536b-aefa-4e5a-b2b5-d6fdd878f6f4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:46.093554 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c427536b-aefa-4e5a-b2b5-d6fdd878f6f4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:46.093976 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c427536b-aefa-4e5a-b2b5-d6fdd878f6f4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:46.095190 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c427536b-aefa-4e5a-b2b5-d6fdd878f6f4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:46.096174 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c427536b-aefa-4e5a-b2b5-d6fdd878f6f4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:46.096174 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c427536b-aefa-4e5a-b2b5-d6fdd878f6f4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:46.227427 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c427536b-aefa-4e5a-b2b5-d6fdd878f6f4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:46.235787 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c427536b-aefa-4e5a-b2b5-d6fdd878f6f4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:46.237228 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c427536b-aefa-4e5a-b2b5-d6fdd878f6f4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:46.238381 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c427536b-aefa-4e5a-b2b5-d6fdd878f6f4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1663 microversion: 2.20 time: 0.156547 Sep 15 19:34:46.238949 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 634/903] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:46 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:46.262586 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-70e56a84-62d8-4901-85bc-306412da2e13 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57123e2c-442e-4e6e-994f-94ac75f36207"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:34:46.265159 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-70e56a84-62d8-4901-85bc-306412da2e13 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:46.271411 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70e56a84-62d8-4901-85bc-306412da2e13 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:46.271914 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70e56a84-62d8-4901-85bc-306412da2e13 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:46.272334 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70e56a84-62d8-4901-85bc-306412da2e13 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:46.273014 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70e56a84-62d8-4901-85bc-306412da2e13 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:46.273462 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70e56a84-62d8-4901-85bc-306412da2e13 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:46.273878 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70e56a84-62d8-4901-85bc-306412da2e13 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:47.493618 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-70e56a84-62d8-4901-85bc-306412da2e13 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "POST /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.234886 Sep 15 19:34:47.494438 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 635/904] 10.222.0.18 () {62 vars in 1364 bytes} [Thu Sep 15 19:34:46 2022] POST /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-volume_attachments => generated 188 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 19:34:47.498955 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c67af7d2-525e-45e6-adbe-722fc91ab99d tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551e992af0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:47.536228 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-c67af7d2-525e-45e6-adbe-722fc91ab99d tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] HTTP exception thrown: Snapshot a59b85a1-4122-475c-9b02-70456c57c27a could not be found. Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c67af7d2-525e-45e6-adbe-722fc91ab99d tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Request method failure captured: Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a HTTP/1.1 Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI35LGXXgpim8iRsgl428m-drQT1EDPIxSJG6ZKkb7-H0NRbedpo7WnFf8KtHBnGRlwnp3pdkGySmXB2GVFuSB1gg-hR7yaKFUqk8jDvAQ4ND_iLL5LxYfk473qduuMkhEYeH-MOVo9xLL7WSdhuaviQ5a5lwpjPSwFR8h9DTw10FZxI Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 62e763646d564589a4b2e7900682a5d7 Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1983352007 Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:34:47.538789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:34:47.540369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_62e763646d564589a4b2e7900682a5d7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/62e763646d564589a4b2e7900682a5d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62e763646d564589a4b2e7900682a5d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62e763646d564589a4b2e7900682a5d7"}]}] Sep 15 19:34:47.540369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1983352007 Sep 15 19:34:47.540369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 62e763646d564589a4b2e7900682a5d7 Sep 15 19:34:47.540369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1983352007 Sep 15 19:34:47.540369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesSnapshotsTestJSON-1983352007-project Sep 15 19:34:47.540369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:34:47.540369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:34:47.540369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 9de8509ca7de423cbf423bfe29dc4f0e Sep 15 19:34:47.540369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1983352007-project Sep 15 19:34:47.540369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: Sep 15 19:34:47.540369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Snapshot a59b85a1-4122-475c-9b02-70456c57c27a could not be found. Sep 15 19:34:47.540369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'a59b85a1-4122-475c-9b02-70456c57c27a'} Sep 15 19:34:47.540369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a59b85a1-4122-475c-9b02-70456c57c27a could not be found. (HTTP 404) (Request-ID: req-5e9309a7-93ba-4dcc-9426-91148ebb6366) Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:47.544702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 19:34:47.545869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a59b85a1-4122-475c-9b02-70456c57c27a could not be found. Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 15 19:34:47.547018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:34:47.549171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a59b85a1-4122-475c-9b02-70456c57c27a could not be found. Sep 15 19:34:47.549171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:47.549171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:47.549171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:47.549171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:47.549171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:47.549171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:47.549171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:34:47.549171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:34:47.549171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a59b85a1-4122-475c-9b02-70456c57c27a could not be found. Sep 15 19:34:47.549171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:47.549171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c67af7d2-525e-45e6-adbe-722fc91ab99d tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Returning 404 to user: Snapshot a59b85a1-4122-475c-9b02-70456c57c27a could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:34:47.549171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c67af7d2-525e-45e6-adbe-722fc91ab99d tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a" status: 404 len: 111 microversion: 2.1 time: 0.045072 Sep 15 19:34:47.550336 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 636/905] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 15 19:34:47 2022] GET /compute/v2.1/os-snapshots/a59b85a1-4122-475c-9b02-70456c57c27a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:34:47.550336 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d6a1d17c-785b-4bc9-9166-06857093049d tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551eb72670>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:47.869273 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d6a1d17c-785b-4bc9-9166-06857093049d tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df" status: 202 len: 0 microversion: 2.1 time: 0.323700 Sep 15 19:34:47.870009 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 637/906] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 15 19:34:47 2022] DELETE /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 19:34:47.874738 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6bb2a7ab-75f1-4906-be50-b80c7a3cb272 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:34:47.875311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6bb2a7ab-75f1-4906-be50-b80c7a3cb272 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:47.882543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6bb2a7ab-75f1-4906-be50-b80c7a3cb272 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:47.883039 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6bb2a7ab-75f1-4906-be50-b80c7a3cb272 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:47.883473 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6bb2a7ab-75f1-4906-be50-b80c7a3cb272 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:47.884193 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6bb2a7ab-75f1-4906-be50-b80c7a3cb272 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:47.884641 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6bb2a7ab-75f1-4906-be50-b80c7a3cb272 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:47.885066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6bb2a7ab-75f1-4906-be50-b80c7a3cb272 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:47.927357 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6bb2a7ab-75f1-4906-be50-b80c7a3cb272 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121041) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 19:34:48.531882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6bb2a7ab-75f1-4906-be50-b80c7a3cb272 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "POST /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/action" status: 202 len: 0 microversion: 2.20 time: 0.660742 Sep 15 19:34:48.536530 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 638/907] 10.222.0.18 () {62 vars in 1319 bytes} [Thu Sep 15 19:34:47 2022] POST /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/action => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 19:34:48.538508 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a09d5d50-712c-4752-91ab-4c5937a971a3 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551ec4a0d0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:48.596539 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a09d5d50-712c-4752-91ab-4c5937a971a3 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df" status: 200 len: 345 microversion: 2.1 time: 0.061925 Sep 15 19:34:48.597111 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 639/908] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:34:48 2022] GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:34:48.601828 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-57f2d1ad-854b-4f0c-b689-9ac3a8480020 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:48.602433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-57f2d1ad-854b-4f0c-b689-9ac3a8480020 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:48.609910 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57f2d1ad-854b-4f0c-b689-9ac3a8480020 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:48.610409 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57f2d1ad-854b-4f0c-b689-9ac3a8480020 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:48.610933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57f2d1ad-854b-4f0c-b689-9ac3a8480020 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:48.611642 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57f2d1ad-854b-4f0c-b689-9ac3a8480020 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:48.612115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57f2d1ad-854b-4f0c-b689-9ac3a8480020 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:48.612538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57f2d1ad-854b-4f0c-b689-9ac3a8480020 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:48.631728 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:34:48.766286 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-57f2d1ad-854b-4f0c-b689-9ac3a8480020 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:48.776165 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-57f2d1ad-854b-4f0c-b689-9ac3a8480020 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:48.778120 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-57f2d1ad-854b-4f0c-b689-9ac3a8480020 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:48.779430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-57f2d1ad-854b-4f0c-b689-9ac3a8480020 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1749 microversion: 2.20 time: 0.181257 Sep 15 19:34:48.780203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 640/909] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:48 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:34:49.611594 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-03a4fb19-8ba2-4899-be72-17b38701e934 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551ec4a280>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:49.640289 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-03a4fb19-8ba2-4899-be72-17b38701e934 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] HTTP exception thrown: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-03a4fb19-8ba2-4899-be72-17b38701e934 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Request method failure captured: Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df HTTP/1.1 Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI35LGXXgpim8iRsgl428m-drQT1EDPIxSJG6ZKkb7-H0NRbedpo7WnFf8KtHBnGRlwnp3pdkGySmXB2GVFuSB1gg-hR7yaKFUqk8jDvAQ4ND_iLL5LxYfk473qduuMkhEYeH-MOVo9xLL7WSdhuaviQ5a5lwpjPSwFR8h9DTw10FZxI Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 62e763646d564589a4b2e7900682a5d7 Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1983352007 Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:34:49.642309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:34:49.644189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_62e763646d564589a4b2e7900682a5d7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/62e763646d564589a4b2e7900682a5d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62e763646d564589a4b2e7900682a5d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62e763646d564589a4b2e7900682a5d7"}]}] Sep 15 19:34:49.644189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1983352007 Sep 15 19:34:49.644189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 62e763646d564589a4b2e7900682a5d7 Sep 15 19:34:49.644189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1983352007 Sep 15 19:34:49.644189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesSnapshotsTestJSON-1983352007-project Sep 15 19:34:49.644189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:34:49.644189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:34:49.644189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 9de8509ca7de423cbf423bfe29dc4f0e Sep 15 19:34:49.644189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1983352007-project Sep 15 19:34:49.644189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: Sep 15 19:34:49.644189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.644189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'eac236fc-6e34-4f98-a589-add0742ac7df'} Sep 15 19:34:49.644189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. (HTTP 404) (Request-ID: req-7cb84901-d0d8-4b71-a278-ac4424e5dc72) Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:49.645189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 19:34:49.646651 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 19:34:49.648941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-03a4fb19-8ba2-4899-be72-17b38701e934 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Returning 404 to user: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-03a4fb19-8ba2-4899-be72-17b38701e934 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df" status: 404 len: 109 microversion: 2.1 time: 0.037280 Sep 15 19:34:49.650636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 641/910] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:34:49 2022] GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:34:49.658877 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0b8e64c7-cf8c-45e6-a623-3bd5036f29c4 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551ec2af70>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:49.687934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-0b8e64c7-cf8c-45e6-a623-3bd5036f29c4 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] HTTP exception thrown: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0b8e64c7-cf8c-45e6-a623-3bd5036f29c4 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Request method failure captured: Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df HTTP/1.1 Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI35LGXXgpim8iRsgl428m-drQT1EDPIxSJG6ZKkb7-H0NRbedpo7WnFf8KtHBnGRlwnp3pdkGySmXB2GVFuSB1gg-hR7yaKFUqk8jDvAQ4ND_iLL5LxYfk473qduuMkhEYeH-MOVo9xLL7WSdhuaviQ5a5lwpjPSwFR8h9DTw10FZxI Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 62e763646d564589a4b2e7900682a5d7 Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1983352007 Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:34:49.692032 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:34:49.693791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_62e763646d564589a4b2e7900682a5d7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/62e763646d564589a4b2e7900682a5d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62e763646d564589a4b2e7900682a5d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62e763646d564589a4b2e7900682a5d7"}]}] Sep 15 19:34:49.693791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1983352007 Sep 15 19:34:49.693791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 62e763646d564589a4b2e7900682a5d7 Sep 15 19:34:49.693791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1983352007 Sep 15 19:34:49.693791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesSnapshotsTestJSON-1983352007-project Sep 15 19:34:49.693791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:34:49.693791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:34:49.693791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 9de8509ca7de423cbf423bfe29dc4f0e Sep 15 19:34:49.693791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1983352007-project Sep 15 19:34:49.693791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: Sep 15 19:34:49.693791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.693791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'eac236fc-6e34-4f98-a589-add0742ac7df'} Sep 15 19:34:49.693791 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. (HTTP 404) (Request-ID: req-15f1a1ea-c710-48c0-9f00-116fcccedc7e) Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:49.694747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 19:34:49.696358 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 19:34:49.697871 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0b8e64c7-cf8c-45e6-a623-3bd5036f29c4 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Returning 404 to user: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0b8e64c7-cf8c-45e6-a623-3bd5036f29c4 tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df" status: 404 len: 109 microversion: 2.1 time: 0.037378 Sep 15 19:34:49.699229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 642/911] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 15 19:34:49 2022] DELETE /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:34:49.700427 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5ef880da-3463-441e-a907-a0f6ec7cf80f tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Calling method '.version_select at 0x7f551ea7e160>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:49.730151 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-5ef880da-3463-441e-a907-a0f6ec7cf80f tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] HTTP exception thrown: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5ef880da-3463-441e-a907-a0f6ec7cf80f tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Request method failure captured: Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df HTTP/1.1 Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI35LGXXgpim8iRsgl428m-drQT1EDPIxSJG6ZKkb7-H0NRbedpo7WnFf8KtHBnGRlwnp3pdkGySmXB2GVFuSB1gg-hR7yaKFUqk8jDvAQ4ND_iLL5LxYfk473qduuMkhEYeH-MOVo9xLL7WSdhuaviQ5a5lwpjPSwFR8h9DTw10FZxI Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 62e763646d564589a4b2e7900682a5d7 Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1983352007 Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:34:49.732304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:34:49.734545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_62e763646d564589a4b2e7900682a5d7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/62e763646d564589a4b2e7900682a5d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62e763646d564589a4b2e7900682a5d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62e763646d564589a4b2e7900682a5d7"}]}] Sep 15 19:34:49.734545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1983352007 Sep 15 19:34:49.734545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 62e763646d564589a4b2e7900682a5d7 Sep 15 19:34:49.734545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1983352007 Sep 15 19:34:49.734545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesSnapshotsTestJSON-1983352007-project Sep 15 19:34:49.734545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:34:49.734545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:34:49.734545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 9de8509ca7de423cbf423bfe29dc4f0e Sep 15 19:34:49.734545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1983352007-project Sep 15 19:34:49.734545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: Sep 15 19:34:49.734545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.734545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'eac236fc-6e34-4f98-a589-add0742ac7df'} Sep 15 19:34:49.734545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. (HTTP 404) (Request-ID: req-4c59047d-9ade-412d-af43-ca25e06eb764) Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:49.735732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 19:34:49.738573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 19:34:49.740188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5ef880da-3463-441e-a907-a0f6ec7cf80f tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] Returning 404 to user: Volume eac236fc-6e34-4f98-a589-add0742ac7df could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5ef880da-3463-441e-a907-a0f6ec7cf80f tempest-VolumesSnapshotsTestJSON-1983352007 tempest-VolumesSnapshotsTestJSON-1983352007-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df" status: 404 len: 109 microversion: 2.1 time: 0.037218 Sep 15 19:34:49.742632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 643/912] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:34:49 2022] GET /compute/v2.1/os-volumes/eac236fc-6e34-4f98-a589-add0742ac7df => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 19:34:49.830642 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-53af3eff-b1c4-4baf-988e-b6427bc33f2d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:49.831258 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-53af3eff-b1c4-4baf-988e-b6427bc33f2d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:49.837905 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53af3eff-b1c4-4baf-988e-b6427bc33f2d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:49.838395 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53af3eff-b1c4-4baf-988e-b6427bc33f2d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:49.838826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53af3eff-b1c4-4baf-988e-b6427bc33f2d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:49.839539 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53af3eff-b1c4-4baf-988e-b6427bc33f2d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:49.840024 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53af3eff-b1c4-4baf-988e-b6427bc33f2d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:49.840563 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53af3eff-b1c4-4baf-988e-b6427bc33f2d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:49.994842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-53af3eff-b1c4-4baf-988e-b6427bc33f2d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:50.001505 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-53af3eff-b1c4-4baf-988e-b6427bc33f2d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:50.002954 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-53af3eff-b1c4-4baf-988e-b6427bc33f2d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:50.004560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-53af3eff-b1c4-4baf-988e-b6427bc33f2d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1749 microversion: 2.20 time: 0.178762 Sep 15 19:34:50.010360 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 644/913] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:49 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1749 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:51.039679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fb434d06-0d31-4786-88aa-7fa3b5d9615c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:51.040320 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fb434d06-0d31-4786-88aa-7fa3b5d9615c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:51.046940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb434d06-0d31-4786-88aa-7fa3b5d9615c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:51.049209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb434d06-0d31-4786-88aa-7fa3b5d9615c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:51.050316 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb434d06-0d31-4786-88aa-7fa3b5d9615c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:51.051209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb434d06-0d31-4786-88aa-7fa3b5d9615c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:51.051866 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb434d06-0d31-4786-88aa-7fa3b5d9615c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:51.052478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb434d06-0d31-4786-88aa-7fa3b5d9615c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:51.190516 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fb434d06-0d31-4786-88aa-7fa3b5d9615c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:51.201773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fb434d06-0d31-4786-88aa-7fa3b5d9615c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:51.203629 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fb434d06-0d31-4786-88aa-7fa3b5d9615c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:51.204993 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fb434d06-0d31-4786-88aa-7fa3b5d9615c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1749 microversion: 2.20 time: 0.175430 Sep 15 19:34:51.205694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 645/914] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:51 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:52.232017 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ca6b60b2-c541-4b81-9f84-26373fdb927d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:52.232673 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ca6b60b2-c541-4b81-9f84-26373fdb927d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:52.240127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ca6b60b2-c541-4b81-9f84-26373fdb927d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:52.240611 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ca6b60b2-c541-4b81-9f84-26373fdb927d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:52.241091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ca6b60b2-c541-4b81-9f84-26373fdb927d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:52.241830 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ca6b60b2-c541-4b81-9f84-26373fdb927d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:52.242274 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ca6b60b2-c541-4b81-9f84-26373fdb927d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:52.242695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ca6b60b2-c541-4b81-9f84-26373fdb927d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:52.381211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ca6b60b2-c541-4b81-9f84-26373fdb927d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:52.390885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ca6b60b2-c541-4b81-9f84-26373fdb927d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:52.393011 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ca6b60b2-c541-4b81-9f84-26373fdb927d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:52.394203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ca6b60b2-c541-4b81-9f84-26373fdb927d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1749 microversion: 2.20 time: 0.166341 Sep 15 19:34:52.394772 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 646/915] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:52 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:53.421363 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6cf7daf9-92d9-44ea-a5c1-f583658dedd7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:53.421978 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6cf7daf9-92d9-44ea-a5c1-f583658dedd7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:53.428790 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7daf9-92d9-44ea-a5c1-f583658dedd7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:53.429273 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7daf9-92d9-44ea-a5c1-f583658dedd7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:53.429706 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7daf9-92d9-44ea-a5c1-f583658dedd7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:53.430400 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7daf9-92d9-44ea-a5c1-f583658dedd7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:53.430850 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7daf9-92d9-44ea-a5c1-f583658dedd7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:53.431274 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7daf9-92d9-44ea-a5c1-f583658dedd7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:53.579793 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6cf7daf9-92d9-44ea-a5c1-f583658dedd7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:53.591300 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6cf7daf9-92d9-44ea-a5c1-f583658dedd7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:53.591300 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6cf7daf9-92d9-44ea-a5c1-f583658dedd7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:53.591702 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6cf7daf9-92d9-44ea-a5c1-f583658dedd7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1749 microversion: 2.20 time: 0.175006 Sep 15 19:34:53.592298 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 647/916] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:53 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:54.617498 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-534df1f1-67c8-4187-a706-b4aa27ee768a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:54.618223 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-534df1f1-67c8-4187-a706-b4aa27ee768a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:54.624851 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-534df1f1-67c8-4187-a706-b4aa27ee768a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:54.625324 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-534df1f1-67c8-4187-a706-b4aa27ee768a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:54.625754 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-534df1f1-67c8-4187-a706-b4aa27ee768a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:54.626440 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-534df1f1-67c8-4187-a706-b4aa27ee768a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:54.626880 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-534df1f1-67c8-4187-a706-b4aa27ee768a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:54.627386 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-534df1f1-67c8-4187-a706-b4aa27ee768a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:54.765894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-534df1f1-67c8-4187-a706-b4aa27ee768a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:54.775625 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-534df1f1-67c8-4187-a706-b4aa27ee768a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:54.778919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-534df1f1-67c8-4187-a706-b4aa27ee768a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:54.778919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-534df1f1-67c8-4187-a706-b4aa27ee768a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1749 microversion: 2.20 time: 0.164851 Sep 15 19:34:54.779413 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 648/917] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:54 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:55.804779 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5e9c653a-fe5e-4113-915a-a71a2a2bf91b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:55.805486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5e9c653a-fe5e-4113-915a-a71a2a2bf91b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:55.811942 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e9c653a-fe5e-4113-915a-a71a2a2bf91b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:55.813126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e9c653a-fe5e-4113-915a-a71a2a2bf91b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:55.813870 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e9c653a-fe5e-4113-915a-a71a2a2bf91b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:55.814581 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e9c653a-fe5e-4113-915a-a71a2a2bf91b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:55.815034 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e9c653a-fe5e-4113-915a-a71a2a2bf91b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:55.815461 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e9c653a-fe5e-4113-915a-a71a2a2bf91b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:55.948100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5e9c653a-fe5e-4113-915a-a71a2a2bf91b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:55.957417 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5e9c653a-fe5e-4113-915a-a71a2a2bf91b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:55.958935 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5e9c653a-fe5e-4113-915a-a71a2a2bf91b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:55.960133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5e9c653a-fe5e-4113-915a-a71a2a2bf91b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1751 microversion: 2.20 time: 0.159665 Sep 15 19:34:55.960697 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 649/918] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:55 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:56.988835 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b7494169-1ad7-45ea-b0ff-65f864c5c9b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:56.988835 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b7494169-1ad7-45ea-b0ff-65f864c5c9b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:56.995465 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7494169-1ad7-45ea-b0ff-65f864c5c9b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:56.995950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7494169-1ad7-45ea-b0ff-65f864c5c9b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:56.996388 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7494169-1ad7-45ea-b0ff-65f864c5c9b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:56.997089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7494169-1ad7-45ea-b0ff-65f864c5c9b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:56.997541 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7494169-1ad7-45ea-b0ff-65f864c5c9b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:56.997970 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b7494169-1ad7-45ea-b0ff-65f864c5c9b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:57.134496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b7494169-1ad7-45ea-b0ff-65f864c5c9b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:57.143388 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b7494169-1ad7-45ea-b0ff-65f864c5c9b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:57.144882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b7494169-1ad7-45ea-b0ff-65f864c5c9b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:57.146019 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b7494169-1ad7-45ea-b0ff-65f864c5c9b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1751 microversion: 2.20 time: 0.163950 Sep 15 19:34:57.146579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 650/919] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:56 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:58.172098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-166c66d4-98ee-4b44-b2b9-06b67d0ef2e0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:58.172757 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-166c66d4-98ee-4b44-b2b9-06b67d0ef2e0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:58.179411 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-166c66d4-98ee-4b44-b2b9-06b67d0ef2e0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:58.179932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-166c66d4-98ee-4b44-b2b9-06b67d0ef2e0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:58.180375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-166c66d4-98ee-4b44-b2b9-06b67d0ef2e0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:58.181082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-166c66d4-98ee-4b44-b2b9-06b67d0ef2e0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:58.181535 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-166c66d4-98ee-4b44-b2b9-06b67d0ef2e0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:58.181960 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-166c66d4-98ee-4b44-b2b9-06b67d0ef2e0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:58.315036 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-166c66d4-98ee-4b44-b2b9-06b67d0ef2e0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:58.324060 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-166c66d4-98ee-4b44-b2b9-06b67d0ef2e0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:58.325560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-166c66d4-98ee-4b44-b2b9-06b67d0ef2e0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:58.326775 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-166c66d4-98ee-4b44-b2b9-06b67d0ef2e0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1751 microversion: 2.20 time: 0.158781 Sep 15 19:34:58.327339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 651/920] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:58 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:34:59.353391 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-247bf0f9-0b21-485f-9fe9-a244f11ea8cc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:34:59.354108 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-247bf0f9-0b21-485f-9fe9-a244f11ea8cc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:34:59.361159 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-247bf0f9-0b21-485f-9fe9-a244f11ea8cc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:59.362315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-247bf0f9-0b21-485f-9fe9-a244f11ea8cc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:59.362795 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-247bf0f9-0b21-485f-9fe9-a244f11ea8cc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:59.363759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-247bf0f9-0b21-485f-9fe9-a244f11ea8cc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:34:59.364163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-247bf0f9-0b21-485f-9fe9-a244f11ea8cc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:34:59.364577 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-247bf0f9-0b21-485f-9fe9-a244f11ea8cc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:34:59.605291 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-247bf0f9-0b21-485f-9fe9-a244f11ea8cc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:59.615096 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-247bf0f9-0b21-485f-9fe9-a244f11ea8cc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:59.616786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-247bf0f9-0b21-485f-9fe9-a244f11ea8cc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:34:59.617972 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-247bf0f9-0b21-485f-9fe9-a244f11ea8cc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.268910 Sep 15 19:34:59.618912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 652/921] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:34:59 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:35:00.644112 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b74024b6-3b80-4e96-b37d-23001bcd8dc6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:00.645396 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b74024b6-3b80-4e96-b37d-23001bcd8dc6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:00.662747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b74024b6-3b80-4e96-b37d-23001bcd8dc6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:00.663575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b74024b6-3b80-4e96-b37d-23001bcd8dc6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:00.664199 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b74024b6-3b80-4e96-b37d-23001bcd8dc6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:00.665252 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b74024b6-3b80-4e96-b37d-23001bcd8dc6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:00.665951 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b74024b6-3b80-4e96-b37d-23001bcd8dc6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:00.666656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b74024b6-3b80-4e96-b37d-23001bcd8dc6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:00.948489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b74024b6-3b80-4e96-b37d-23001bcd8dc6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:00.965518 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b74024b6-3b80-4e96-b37d-23001bcd8dc6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:00.968903 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b74024b6-3b80-4e96-b37d-23001bcd8dc6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:00.971342 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b74024b6-3b80-4e96-b37d-23001bcd8dc6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.330218 Sep 15 19:35:00.971813 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 653/922] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:00 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:35:02.004292 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ee8ff01d-680b-40b8-8dad-55a0c70ff53a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:02.005393 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ee8ff01d-680b-40b8-8dad-55a0c70ff53a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:02.012400 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee8ff01d-680b-40b8-8dad-55a0c70ff53a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:02.013016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee8ff01d-680b-40b8-8dad-55a0c70ff53a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:02.013558 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee8ff01d-680b-40b8-8dad-55a0c70ff53a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:02.014362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee8ff01d-680b-40b8-8dad-55a0c70ff53a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:02.014912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee8ff01d-680b-40b8-8dad-55a0c70ff53a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:02.015440 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee8ff01d-680b-40b8-8dad-55a0c70ff53a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:02.209537 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ee8ff01d-680b-40b8-8dad-55a0c70ff53a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:02.218701 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ee8ff01d-680b-40b8-8dad-55a0c70ff53a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:02.220216 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ee8ff01d-680b-40b8-8dad-55a0c70ff53a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:02.221435 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ee8ff01d-680b-40b8-8dad-55a0c70ff53a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.223464 Sep 15 19:35:02.235679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 654/923] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:01 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:35:03.248777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3d43a48c-c087-4f0f-8232-4ebb4323c349 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:03.250295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3d43a48c-c087-4f0f-8232-4ebb4323c349 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:03.258104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3d43a48c-c087-4f0f-8232-4ebb4323c349 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:03.258960 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3d43a48c-c087-4f0f-8232-4ebb4323c349 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:03.259632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3d43a48c-c087-4f0f-8232-4ebb4323c349 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:03.260590 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3d43a48c-c087-4f0f-8232-4ebb4323c349 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:03.261256 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3d43a48c-c087-4f0f-8232-4ebb4323c349 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:03.261912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3d43a48c-c087-4f0f-8232-4ebb4323c349 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:03.433155 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3d43a48c-c087-4f0f-8232-4ebb4323c349 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:03.446328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3d43a48c-c087-4f0f-8232-4ebb4323c349 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:03.453925 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3d43a48c-c087-4f0f-8232-4ebb4323c349 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:03.456444 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3d43a48c-c087-4f0f-8232-4ebb4323c349 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.211598 Sep 15 19:35:03.472366 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 655/924] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:03 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:35:04.488759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c6b8d892-e228-4afc-ae24-6ae2ccd1e066 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:04.490204 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c6b8d892-e228-4afc-ae24-6ae2ccd1e066 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:04.507010 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c6b8d892-e228-4afc-ae24-6ae2ccd1e066 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:04.511906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c6b8d892-e228-4afc-ae24-6ae2ccd1e066 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:04.511906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c6b8d892-e228-4afc-ae24-6ae2ccd1e066 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:04.511906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c6b8d892-e228-4afc-ae24-6ae2ccd1e066 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:04.511906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c6b8d892-e228-4afc-ae24-6ae2ccd1e066 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:04.513561 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c6b8d892-e228-4afc-ae24-6ae2ccd1e066 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:04.680805 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c6b8d892-e228-4afc-ae24-6ae2ccd1e066 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:04.708390 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c6b8d892-e228-4afc-ae24-6ae2ccd1e066 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:04.711207 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c6b8d892-e228-4afc-ae24-6ae2ccd1e066 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:04.713238 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c6b8d892-e228-4afc-ae24-6ae2ccd1e066 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.231620 Sep 15 19:35:04.731877 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 656/925] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:04 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:35:05.746605 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-92a3a033-eee6-47b3-8896-176f83568cfb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:05.755982 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-92a3a033-eee6-47b3-8896-176f83568cfb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:05.772179 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92a3a033-eee6-47b3-8896-176f83568cfb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:05.773042 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92a3a033-eee6-47b3-8896-176f83568cfb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:05.773792 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92a3a033-eee6-47b3-8896-176f83568cfb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:05.775013 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92a3a033-eee6-47b3-8896-176f83568cfb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:05.781640 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92a3a033-eee6-47b3-8896-176f83568cfb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:05.782772 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92a3a033-eee6-47b3-8896-176f83568cfb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:06.084540 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-92a3a033-eee6-47b3-8896-176f83568cfb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:06.100193 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-92a3a033-eee6-47b3-8896-176f83568cfb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:06.106206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-92a3a033-eee6-47b3-8896-176f83568cfb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:06.107946 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-92a3a033-eee6-47b3-8896-176f83568cfb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.369965 Sep 15 19:35:06.113858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 657/926] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:05 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:35:07.154102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-54f64ce5-8a49-4eab-9e6a-e797bb479d4c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:07.157628 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-54f64ce5-8a49-4eab-9e6a-e797bb479d4c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:07.189865 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54f64ce5-8a49-4eab-9e6a-e797bb479d4c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:07.190774 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54f64ce5-8a49-4eab-9e6a-e797bb479d4c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:07.192099 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54f64ce5-8a49-4eab-9e6a-e797bb479d4c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:07.193102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54f64ce5-8a49-4eab-9e6a-e797bb479d4c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:07.193801 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54f64ce5-8a49-4eab-9e6a-e797bb479d4c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:07.194474 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54f64ce5-8a49-4eab-9e6a-e797bb479d4c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:07.409038 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-54f64ce5-8a49-4eab-9e6a-e797bb479d4c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:07.425919 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-54f64ce5-8a49-4eab-9e6a-e797bb479d4c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:07.427623 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-54f64ce5-8a49-4eab-9e6a-e797bb479d4c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:07.429068 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-54f64ce5-8a49-4eab-9e6a-e797bb479d4c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.280739 Sep 15 19:35:07.430100 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 658/927] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:07 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:35:08.457550 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ea43c4f9-a5b0-426d-ad61-50d36ca03f32 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:08.459445 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ea43c4f9-a5b0-426d-ad61-50d36ca03f32 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:08.467270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea43c4f9-a5b0-426d-ad61-50d36ca03f32 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:08.467793 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea43c4f9-a5b0-426d-ad61-50d36ca03f32 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:08.468421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea43c4f9-a5b0-426d-ad61-50d36ca03f32 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:08.469307 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea43c4f9-a5b0-426d-ad61-50d36ca03f32 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:08.470262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea43c4f9-a5b0-426d-ad61-50d36ca03f32 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:08.471193 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea43c4f9-a5b0-426d-ad61-50d36ca03f32 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:08.630675 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ea43c4f9-a5b0-426d-ad61-50d36ca03f32 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:08.641339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ea43c4f9-a5b0-426d-ad61-50d36ca03f32 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:08.643641 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ea43c4f9-a5b0-426d-ad61-50d36ca03f32 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:08.645116 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ea43c4f9-a5b0-426d-ad61-50d36ca03f32 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.192994 Sep 15 19:35:08.645937 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 659/928] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:08 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:35:08.680522 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-487c5ef7-f458-416a-bb1e-2eec87b06624 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:35:08.681366 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-487c5ef7-f458-416a-bb1e-2eec87b06624 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:08.693406 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-487c5ef7-f458-416a-bb1e-2eec87b06624 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:08.693906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-487c5ef7-f458-416a-bb1e-2eec87b06624 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:08.694549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-487c5ef7-f458-416a-bb1e-2eec87b06624 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:08.695508 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-487c5ef7-f458-416a-bb1e-2eec87b06624 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:08.696172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-487c5ef7-f458-416a-bb1e-2eec87b06624 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:08.696602 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-487c5ef7-f458-416a-bb1e-2eec87b06624 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:08.700890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:35:08.728945 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-487c5ef7-f458-416a-bb1e-2eec87b06624 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lazy-loading 'flavor' on Instance uuid eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:35:09.036485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-487c5ef7-f458-416a-bb1e-2eec87b06624 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "POST /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65/action" status: 202 len: 0 microversion: 2.1 time: 0.359716 Sep 15 19:35:09.038428 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 660/929] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:35:08 2022] POST /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:35:09.050145 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-207f03f8-d37a-4e83-b896-1692015b1547 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:09.050829 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-207f03f8-d37a-4e83-b896-1692015b1547 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:09.060036 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-207f03f8-d37a-4e83-b896-1692015b1547 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:09.060548 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-207f03f8-d37a-4e83-b896-1692015b1547 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:09.061638 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-207f03f8-d37a-4e83-b896-1692015b1547 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:09.062422 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-207f03f8-d37a-4e83-b896-1692015b1547 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:09.063095 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-207f03f8-d37a-4e83-b896-1692015b1547 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:09.063803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-207f03f8-d37a-4e83-b896-1692015b1547 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:09.254587 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-207f03f8-d37a-4e83-b896-1692015b1547 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:09.266574 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-207f03f8-d37a-4e83-b896-1692015b1547 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.221122 Sep 15 19:35:09.288108 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 661/930] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:09 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:35:09.672996 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2f734db1-9dbd-4e11-8f79-5b78dfaef01a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:09.674196 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2f734db1-9dbd-4e11-8f79-5b78dfaef01a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:09.680307 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f734db1-9dbd-4e11-8f79-5b78dfaef01a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:09.680803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f734db1-9dbd-4e11-8f79-5b78dfaef01a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:09.681237 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f734db1-9dbd-4e11-8f79-5b78dfaef01a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:09.681950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f734db1-9dbd-4e11-8f79-5b78dfaef01a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:09.682610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f734db1-9dbd-4e11-8f79-5b78dfaef01a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:09.683036 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f734db1-9dbd-4e11-8f79-5b78dfaef01a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:09.869549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2f734db1-9dbd-4e11-8f79-5b78dfaef01a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:09.881771 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2f734db1-9dbd-4e11-8f79-5b78dfaef01a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:09.884380 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2f734db1-9dbd-4e11-8f79-5b78dfaef01a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:09.885857 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2f734db1-9dbd-4e11-8f79-5b78dfaef01a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.217063 Sep 15 19:35:09.886968 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 662/931] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:09 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:35:10.311466 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c5ab9e7a-b344-43da-9246-bef780afe01e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:10.326028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c5ab9e7a-b344-43da-9246-bef780afe01e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:10.343587 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:35:10.358218 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5ab9e7a-b344-43da-9246-bef780afe01e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:10.358218 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5ab9e7a-b344-43da-9246-bef780afe01e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:10.358218 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5ab9e7a-b344-43da-9246-bef780afe01e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:10.358218 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5ab9e7a-b344-43da-9246-bef780afe01e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:10.358953 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5ab9e7a-b344-43da-9246-bef780afe01e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:10.358953 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5ab9e7a-b344-43da-9246-bef780afe01e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:10.502660 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c5ab9e7a-b344-43da-9246-bef780afe01e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:10.510687 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c5ab9e7a-b344-43da-9246-bef780afe01e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.211895 Sep 15 19:35:10.511272 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 663/932] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:10 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:35:10.913573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bea41fdc-cf93-48e1-b4c5-2e3e92e7cd57 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:10.914272 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bea41fdc-cf93-48e1-b4c5-2e3e92e7cd57 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:10.921223 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bea41fdc-cf93-48e1-b4c5-2e3e92e7cd57 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:10.922045 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bea41fdc-cf93-48e1-b4c5-2e3e92e7cd57 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:10.922200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bea41fdc-cf93-48e1-b4c5-2e3e92e7cd57 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:10.922914 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bea41fdc-cf93-48e1-b4c5-2e3e92e7cd57 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:10.923378 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bea41fdc-cf93-48e1-b4c5-2e3e92e7cd57 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:10.924354 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bea41fdc-cf93-48e1-b4c5-2e3e92e7cd57 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:11.093953 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bea41fdc-cf93-48e1-b4c5-2e3e92e7cd57 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:11.104859 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bea41fdc-cf93-48e1-b4c5-2e3e92e7cd57 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:11.106473 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bea41fdc-cf93-48e1-b4c5-2e3e92e7cd57 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:11.107733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bea41fdc-cf93-48e1-b4c5-2e3e92e7cd57 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.198135 Sep 15 19:35:11.108254 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 664/933] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:10 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:35:11.543509 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-93cb1523-f0e1-46e6-b8e0-a9c8b859eb8f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:11.544680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-93cb1523-f0e1-46e6-b8e0-a9c8b859eb8f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:11.557365 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93cb1523-f0e1-46e6-b8e0-a9c8b859eb8f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:11.559165 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93cb1523-f0e1-46e6-b8e0-a9c8b859eb8f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:11.560272 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93cb1523-f0e1-46e6-b8e0-a9c8b859eb8f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:11.562182 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93cb1523-f0e1-46e6-b8e0-a9c8b859eb8f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:11.563848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93cb1523-f0e1-46e6-b8e0-a9c8b859eb8f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:11.565203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93cb1523-f0e1-46e6-b8e0-a9c8b859eb8f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:11.744391 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-93cb1523-f0e1-46e6-b8e0-a9c8b859eb8f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:11.754205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-93cb1523-f0e1-46e6-b8e0-a9c8b859eb8f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.218794 Sep 15 19:35:11.758528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 665/934] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:11 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:35:12.135519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f77119fa-1fe5-40d2-822b-10d0072122b9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:12.140339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f77119fa-1fe5-40d2-822b-10d0072122b9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:12.146073 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f77119fa-1fe5-40d2-822b-10d0072122b9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:12.146940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f77119fa-1fe5-40d2-822b-10d0072122b9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:12.147472 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f77119fa-1fe5-40d2-822b-10d0072122b9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:12.148309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f77119fa-1fe5-40d2-822b-10d0072122b9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:12.148837 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f77119fa-1fe5-40d2-822b-10d0072122b9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:12.149356 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f77119fa-1fe5-40d2-822b-10d0072122b9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:12.298578 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f77119fa-1fe5-40d2-822b-10d0072122b9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:12.305333 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f77119fa-1fe5-40d2-822b-10d0072122b9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:12.307133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f77119fa-1fe5-40d2-822b-10d0072122b9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:12.308526 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f77119fa-1fe5-40d2-822b-10d0072122b9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.176957 Sep 15 19:35:12.309270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 666/935] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:12 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:35:12.778592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cdf3aa80-8aab-4e70-87b5-affa55fa74ad tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:12.779202 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cdf3aa80-8aab-4e70-87b5-affa55fa74ad tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:12.790313 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cdf3aa80-8aab-4e70-87b5-affa55fa74ad tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:12.790313 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cdf3aa80-8aab-4e70-87b5-affa55fa74ad tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:12.790313 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cdf3aa80-8aab-4e70-87b5-affa55fa74ad tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:12.790313 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cdf3aa80-8aab-4e70-87b5-affa55fa74ad tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:12.790947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cdf3aa80-8aab-4e70-87b5-affa55fa74ad tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:12.790947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cdf3aa80-8aab-4e70-87b5-affa55fa74ad tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:12.935215 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cdf3aa80-8aab-4e70-87b5-affa55fa74ad tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:12.943414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cdf3aa80-8aab-4e70-87b5-affa55fa74ad tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.168847 Sep 15 19:35:12.944029 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 667/936] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:12 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:13.335318 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-401e148d-9531-4e14-bebc-a97848e5e07d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:13.336022 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-401e148d-9531-4e14-bebc-a97848e5e07d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:13.342424 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-401e148d-9531-4e14-bebc-a97848e5e07d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:13.342900 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-401e148d-9531-4e14-bebc-a97848e5e07d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:13.343334 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-401e148d-9531-4e14-bebc-a97848e5e07d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:13.344064 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-401e148d-9531-4e14-bebc-a97848e5e07d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:13.344527 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-401e148d-9531-4e14-bebc-a97848e5e07d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:13.344944 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-401e148d-9531-4e14-bebc-a97848e5e07d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:13.505246 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-401e148d-9531-4e14-bebc-a97848e5e07d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:13.520299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-401e148d-9531-4e14-bebc-a97848e5e07d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:13.525487 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-401e148d-9531-4e14-bebc-a97848e5e07d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:13.525487 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-401e148d-9531-4e14-bebc-a97848e5e07d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.193503 Sep 15 19:35:13.526169 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 668/937] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:13 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:35:13.968076 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d6560bff-a613-40fa-8243-685609b4fb20 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:13.968860 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d6560bff-a613-40fa-8243-685609b4fb20 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:13.975851 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6560bff-a613-40fa-8243-685609b4fb20 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:13.976276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6560bff-a613-40fa-8243-685609b4fb20 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:13.976780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6560bff-a613-40fa-8243-685609b4fb20 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:13.977483 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6560bff-a613-40fa-8243-685609b4fb20 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:13.977941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6560bff-a613-40fa-8243-685609b4fb20 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:13.978363 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6560bff-a613-40fa-8243-685609b4fb20 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:14.129528 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d6560bff-a613-40fa-8243-685609b4fb20 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:14.133809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d6560bff-a613-40fa-8243-685609b4fb20 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.169486 Sep 15 19:35:14.134425 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 669/938] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:13 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:14.551485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a46fb639-b8f6-4dfc-a324-222ce3c6ce2a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:14.552171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a46fb639-b8f6-4dfc-a324-222ce3c6ce2a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:14.558635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a46fb639-b8f6-4dfc-a324-222ce3c6ce2a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:14.559107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a46fb639-b8f6-4dfc-a324-222ce3c6ce2a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:14.559545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a46fb639-b8f6-4dfc-a324-222ce3c6ce2a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:14.560268 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a46fb639-b8f6-4dfc-a324-222ce3c6ce2a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:14.560723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a46fb639-b8f6-4dfc-a324-222ce3c6ce2a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:14.561153 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a46fb639-b8f6-4dfc-a324-222ce3c6ce2a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:14.719772 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a46fb639-b8f6-4dfc-a324-222ce3c6ce2a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:14.729119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a46fb639-b8f6-4dfc-a324-222ce3c6ce2a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:14.730582 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a46fb639-b8f6-4dfc-a324-222ce3c6ce2a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:14.731785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a46fb639-b8f6-4dfc-a324-222ce3c6ce2a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.184848 Sep 15 19:35:14.732353 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 670/939] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:14 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:35:15.157232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-765e1420-0e4d-4fe8-97c8-1d2439d2f463 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:15.157853 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-765e1420-0e4d-4fe8-97c8-1d2439d2f463 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:15.164334 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-765e1420-0e4d-4fe8-97c8-1d2439d2f463 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:15.164822 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-765e1420-0e4d-4fe8-97c8-1d2439d2f463 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:15.165301 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-765e1420-0e4d-4fe8-97c8-1d2439d2f463 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:15.166041 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-765e1420-0e4d-4fe8-97c8-1d2439d2f463 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:15.166542 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-765e1420-0e4d-4fe8-97c8-1d2439d2f463 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:15.166985 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-765e1420-0e4d-4fe8-97c8-1d2439d2f463 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:15.314576 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-765e1420-0e4d-4fe8-97c8-1d2439d2f463 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:15.323176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-765e1420-0e4d-4fe8-97c8-1d2439d2f463 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.169884 Sep 15 19:35:15.323784 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 671/940] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:15 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:15.756591 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bc1b9673-4078-4cb8-b1f8-9bf2435d6ff0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:15.757329 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bc1b9673-4078-4cb8-b1f8-9bf2435d6ff0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:15.764441 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc1b9673-4078-4cb8-b1f8-9bf2435d6ff0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:15.765030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc1b9673-4078-4cb8-b1f8-9bf2435d6ff0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:15.765380 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc1b9673-4078-4cb8-b1f8-9bf2435d6ff0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:15.766090 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc1b9673-4078-4cb8-b1f8-9bf2435d6ff0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:15.766545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc1b9673-4078-4cb8-b1f8-9bf2435d6ff0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:15.766970 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc1b9673-4078-4cb8-b1f8-9bf2435d6ff0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:15.932306 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bc1b9673-4078-4cb8-b1f8-9bf2435d6ff0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:15.942333 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bc1b9673-4078-4cb8-b1f8-9bf2435d6ff0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:15.944088 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bc1b9673-4078-4cb8-b1f8-9bf2435d6ff0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:15.945842 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bc1b9673-4078-4cb8-b1f8-9bf2435d6ff0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.193260 Sep 15 19:35:15.946689 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 672/941] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:15 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:35:16.347968 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-afb86379-b507-4769-8958-d65ebebed43c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:16.348589 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-afb86379-b507-4769-8958-d65ebebed43c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:16.360453 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-afb86379-b507-4769-8958-d65ebebed43c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:16.360453 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-afb86379-b507-4769-8958-d65ebebed43c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:16.360453 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-afb86379-b507-4769-8958-d65ebebed43c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:16.360453 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-afb86379-b507-4769-8958-d65ebebed43c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:16.361067 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-afb86379-b507-4769-8958-d65ebebed43c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:16.361067 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-afb86379-b507-4769-8958-d65ebebed43c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:16.606907 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-afb86379-b507-4769-8958-d65ebebed43c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:16.618507 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-afb86379-b507-4769-8958-d65ebebed43c tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.275761 Sep 15 19:35:16.623535 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 673/942] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:16 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:16.978627 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b3b49991-c6b1-4693-b025-93beeb99c8fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:16.980317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b3b49991-c6b1-4693-b025-93beeb99c8fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:16.988065 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3b49991-c6b1-4693-b025-93beeb99c8fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:16.988957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3b49991-c6b1-4693-b025-93beeb99c8fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:16.989401 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3b49991-c6b1-4693-b025-93beeb99c8fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:17.009127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3b49991-c6b1-4693-b025-93beeb99c8fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:17.009127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3b49991-c6b1-4693-b025-93beeb99c8fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:17.009127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3b49991-c6b1-4693-b025-93beeb99c8fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:17.165815 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b3b49991-c6b1-4693-b025-93beeb99c8fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:17.169429 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:35:17.175327 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b3b49991-c6b1-4693-b025-93beeb99c8fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:17.177236 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b3b49991-c6b1-4693-b025-93beeb99c8fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:17.178152 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b3b49991-c6b1-4693-b025-93beeb99c8fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.209692 Sep 15 19:35:17.179684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 674/943] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:16 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:35:17.187751 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-e3392ffd-48b6-4217-87fb-bddf6393ef54 req-2ed0a24b-cecd-4753-8be3-6d68b621055d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4", "name": "network-vif-plugged", "status": "completed", "tag": "143ce322-19a2-43c5-83ec-ba67ce8ce7cc"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:35:17.198952 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e3392ffd-48b6-4217-87fb-bddf6393ef54 req-2ed0a24b-cecd-4753-8be3-6d68b621055d service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:17.199397 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e3392ffd-48b6-4217-87fb-bddf6393ef54 req-2ed0a24b-cecd-4753-8be3-6d68b621055d service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:17.203551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e3392ffd-48b6-4217-87fb-bddf6393ef54 req-2ed0a24b-cecd-4753-8be3-6d68b621055d service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:17.212553 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-e3392ffd-48b6-4217-87fb-bddf6393ef54 req-2ed0a24b-cecd-4753-8be3-6d68b621055d service nova] Creating event network-vif-plugged:143ce322-19a2-43c5-83ec-ba67ce8ce7cc for instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 on hv-cinder-84984 Sep 15 19:35:17.218322 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-e3392ffd-48b6-4217-87fb-bddf6393ef54 req-2ed0a24b-cecd-4753-8be3-6d68b621055d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035280 Sep 15 19:35:17.219482 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 675/944] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:35:17.646600 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-76eb3073-3881-44e2-8d59-594321ffe2da tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:17.647306 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-76eb3073-3881-44e2-8d59-594321ffe2da tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:17.664456 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-76eb3073-3881-44e2-8d59-594321ffe2da tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:17.664948 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-76eb3073-3881-44e2-8d59-594321ffe2da tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:17.665436 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-76eb3073-3881-44e2-8d59-594321ffe2da tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:17.666166 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-76eb3073-3881-44e2-8d59-594321ffe2da tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:17.666841 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-76eb3073-3881-44e2-8d59-594321ffe2da tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:17.667511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-76eb3073-3881-44e2-8d59-594321ffe2da tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:17.849864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-76eb3073-3881-44e2-8d59-594321ffe2da tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:17.858855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-76eb3073-3881-44e2-8d59-594321ffe2da tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.216550 Sep 15 19:35:17.860079 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 676/945] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:17 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:18.207694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2d311301-c3c1-485f-ab64-a6fa42a6946c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:18.208390 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2d311301-c3c1-485f-ab64-a6fa42a6946c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:18.216109 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2d311301-c3c1-485f-ab64-a6fa42a6946c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:18.216596 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2d311301-c3c1-485f-ab64-a6fa42a6946c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:18.217187 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2d311301-c3c1-485f-ab64-a6fa42a6946c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:18.217838 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2d311301-c3c1-485f-ab64-a6fa42a6946c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:18.218479 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2d311301-c3c1-485f-ab64-a6fa42a6946c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:18.219074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2d311301-c3c1-485f-ab64-a6fa42a6946c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:18.384144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2d311301-c3c1-485f-ab64-a6fa42a6946c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:18.393637 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2d311301-c3c1-485f-ab64-a6fa42a6946c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:18.395862 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2d311301-c3c1-485f-ab64-a6fa42a6946c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:18.397177 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2d311301-c3c1-485f-ab64-a6fa42a6946c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.194863 Sep 15 19:35:18.397743 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 677/946] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:18 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:35:18.885476 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-eb1598a7-2f6e-45f1-986d-f33552ca83a2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:18.887820 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-eb1598a7-2f6e-45f1-986d-f33552ca83a2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:18.893531 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb1598a7-2f6e-45f1-986d-f33552ca83a2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:18.894110 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb1598a7-2f6e-45f1-986d-f33552ca83a2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:18.894653 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb1598a7-2f6e-45f1-986d-f33552ca83a2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:18.895532 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb1598a7-2f6e-45f1-986d-f33552ca83a2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:18.896324 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb1598a7-2f6e-45f1-986d-f33552ca83a2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:18.896826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb1598a7-2f6e-45f1-986d-f33552ca83a2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:19.085207 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-eb1598a7-2f6e-45f1-986d-f33552ca83a2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:19.093137 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-eb1598a7-2f6e-45f1-986d-f33552ca83a2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.212346 Sep 15 19:35:19.093731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 678/947] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:18 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:19.426708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-15b49405-8b38-4212-97e9-4bdc85c12ab3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:19.427384 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-15b49405-8b38-4212-97e9-4bdc85c12ab3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:19.433931 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-15b49405-8b38-4212-97e9-4bdc85c12ab3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:19.437916 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-15b49405-8b38-4212-97e9-4bdc85c12ab3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:19.437916 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-15b49405-8b38-4212-97e9-4bdc85c12ab3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:19.437916 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-15b49405-8b38-4212-97e9-4bdc85c12ab3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:19.437916 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-15b49405-8b38-4212-97e9-4bdc85c12ab3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:19.438386 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-15b49405-8b38-4212-97e9-4bdc85c12ab3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:19.717954 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-15b49405-8b38-4212-97e9-4bdc85c12ab3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:19.727773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-15b49405-8b38-4212-97e9-4bdc85c12ab3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:19.729947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-15b49405-8b38-4212-97e9-4bdc85c12ab3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:19.731393 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-15b49405-8b38-4212-97e9-4bdc85c12ab3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.309483 Sep 15 19:35:19.731991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 679/948] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:19 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:35:20.118892 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0216c901-30f0-413c-947d-fd735426b8af tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:20.119850 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0216c901-30f0-413c-947d-fd735426b8af tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:20.128785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0216c901-30f0-413c-947d-fd735426b8af tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:20.129695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0216c901-30f0-413c-947d-fd735426b8af tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:20.130170 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0216c901-30f0-413c-947d-fd735426b8af tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:20.130836 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0216c901-30f0-413c-947d-fd735426b8af tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:20.131313 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0216c901-30f0-413c-947d-fd735426b8af tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:20.131756 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0216c901-30f0-413c-947d-fd735426b8af tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:20.340200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0216c901-30f0-413c-947d-fd735426b8af tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:20.349582 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0216c901-30f0-413c-947d-fd735426b8af tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.235313 Sep 15 19:35:20.350203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 680/949] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:20 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:35:20.763112 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-964081af-e4e7-47ab-b94a-d4790d444249 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:20.765636 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-964081af-e4e7-47ab-b94a-d4790d444249 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:20.775338 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-964081af-e4e7-47ab-b94a-d4790d444249 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:20.775855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-964081af-e4e7-47ab-b94a-d4790d444249 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:20.776295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-964081af-e4e7-47ab-b94a-d4790d444249 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:20.777007 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-964081af-e4e7-47ab-b94a-d4790d444249 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:20.777458 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-964081af-e4e7-47ab-b94a-d4790d444249 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:20.777886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-964081af-e4e7-47ab-b94a-d4790d444249 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:20.933882 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-964081af-e4e7-47ab-b94a-d4790d444249 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:20.943589 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-964081af-e4e7-47ab-b94a-d4790d444249 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:20.945069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-964081af-e4e7-47ab-b94a-d4790d444249 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:20.946241 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-964081af-e4e7-47ab-b94a-d4790d444249 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1807 microversion: 2.20 time: 0.190560 Sep 15 19:35:20.946800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 681/950] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:20 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:35:21.374396 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-eb882616-3a03-4f3e-89cd-60b561ab408e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:21.375016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-eb882616-3a03-4f3e-89cd-60b561ab408e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:21.381058 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb882616-3a03-4f3e-89cd-60b561ab408e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:21.381541 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb882616-3a03-4f3e-89cd-60b561ab408e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:21.382006 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb882616-3a03-4f3e-89cd-60b561ab408e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:21.382740 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb882616-3a03-4f3e-89cd-60b561ab408e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:21.383317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb882616-3a03-4f3e-89cd-60b561ab408e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:21.383770 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb882616-3a03-4f3e-89cd-60b561ab408e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:21.537182 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-eb882616-3a03-4f3e-89cd-60b561ab408e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:21.545297 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-eb882616-3a03-4f3e-89cd-60b561ab408e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.175447 Sep 15 19:35:21.546345 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 682/951] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:21 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:21.974715 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0c108496-00f9-43a9-97af-0b2b929692c9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:21.975395 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0c108496-00f9-43a9-97af-0b2b929692c9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:21.981943 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c108496-00f9-43a9-97af-0b2b929692c9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:21.982421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c108496-00f9-43a9-97af-0b2b929692c9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:21.986889 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c108496-00f9-43a9-97af-0b2b929692c9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:21.986889 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c108496-00f9-43a9-97af-0b2b929692c9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:21.986889 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c108496-00f9-43a9-97af-0b2b929692c9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:21.986889 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c108496-00f9-43a9-97af-0b2b929692c9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:22.124119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0c108496-00f9-43a9-97af-0b2b929692c9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:22.133591 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0c108496-00f9-43a9-97af-0b2b929692c9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:22.135141 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0c108496-00f9-43a9-97af-0b2b929692c9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:22.136370 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0c108496-00f9-43a9-97af-0b2b929692c9 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1794 microversion: 2.20 time: 0.167113 Sep 15 19:35:22.136953 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 683/952] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:21 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1794 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:35:22.572895 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-965199a7-ef9c-4f1b-9d38-7089d1ccd4e5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:22.573505 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-965199a7-ef9c-4f1b-9d38-7089d1ccd4e5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:22.579742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-965199a7-ef9c-4f1b-9d38-7089d1ccd4e5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:22.580172 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-965199a7-ef9c-4f1b-9d38-7089d1ccd4e5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:22.580602 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-965199a7-ef9c-4f1b-9d38-7089d1ccd4e5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:22.581298 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-965199a7-ef9c-4f1b-9d38-7089d1ccd4e5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:22.581745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-965199a7-ef9c-4f1b-9d38-7089d1ccd4e5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:22.582217 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-965199a7-ef9c-4f1b-9d38-7089d1ccd4e5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:22.724924 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-965199a7-ef9c-4f1b-9d38-7089d1ccd4e5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:22.733997 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-965199a7-ef9c-4f1b-9d38-7089d1ccd4e5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.164790 Sep 15 19:35:22.734788 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 684/953] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:22 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:23.759973 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d7bfd82a-62cf-40fa-86d8-125927b87dc7 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:23.765129 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d7bfd82a-62cf-40fa-86d8-125927b87dc7 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:23.767401 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7bfd82a-62cf-40fa-86d8-125927b87dc7 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:23.767991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7bfd82a-62cf-40fa-86d8-125927b87dc7 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:23.769995 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7bfd82a-62cf-40fa-86d8-125927b87dc7 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:23.770802 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7bfd82a-62cf-40fa-86d8-125927b87dc7 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:23.771183 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7bfd82a-62cf-40fa-86d8-125927b87dc7 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:23.771614 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7bfd82a-62cf-40fa-86d8-125927b87dc7 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:23.918331 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d7bfd82a-62cf-40fa-86d8-125927b87dc7 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:23.927108 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d7bfd82a-62cf-40fa-86d8-125927b87dc7 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1508 microversion: 2.1 time: 0.171912 Sep 15 19:35:23.927721 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 685/954] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:23 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:23.952616 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9283f0b2-e5db-477d-b27b-1cfe1608da6e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:35:23.953213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9283f0b2-e5db-477d-b27b-1cfe1608da6e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:23.959377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9283f0b2-e5db-477d-b27b-1cfe1608da6e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:23.959925 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9283f0b2-e5db-477d-b27b-1cfe1608da6e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:23.960375 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9283f0b2-e5db-477d-b27b-1cfe1608da6e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:23.961080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9283f0b2-e5db-477d-b27b-1cfe1608da6e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:23.961532 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9283f0b2-e5db-477d-b27b-1cfe1608da6e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:23.961962 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9283f0b2-e5db-477d-b27b-1cfe1608da6e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:23.992752 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9283f0b2-e5db-477d-b27b-1cfe1608da6e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121041) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 19:35:24.504875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9283f0b2-e5db-477d-b27b-1cfe1608da6e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "POST /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65/action" status: 202 len: 0 microversion: 2.1 time: 0.555939 Sep 15 19:35:24.505562 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 686/955] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 15 19:35:23 2022] POST /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 19:35:24.513625 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8ded992d-b720-4c8b-a2b7-e5967f872c7b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:24.514327 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8ded992d-b720-4c8b-a2b7-e5967f872c7b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:24.520968 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ded992d-b720-4c8b-a2b7-e5967f872c7b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:24.521447 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ded992d-b720-4c8b-a2b7-e5967f872c7b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:24.521885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ded992d-b720-4c8b-a2b7-e5967f872c7b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:24.522590 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ded992d-b720-4c8b-a2b7-e5967f872c7b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:24.523048 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ded992d-b720-4c8b-a2b7-e5967f872c7b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:24.523475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8ded992d-b720-4c8b-a2b7-e5967f872c7b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:24.657071 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8ded992d-b720-4c8b-a2b7-e5967f872c7b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:24.664806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8ded992d-b720-4c8b-a2b7-e5967f872c7b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1516 microversion: 2.1 time: 0.154867 Sep 15 19:35:24.665376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 687/956] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:24 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:25.689712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-84d98356-822f-4f98-8fac-a1854449ad01 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:25.690809 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-84d98356-822f-4f98-8fac-a1854449ad01 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:25.699190 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84d98356-822f-4f98-8fac-a1854449ad01 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:25.699667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84d98356-822f-4f98-8fac-a1854449ad01 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:25.700633 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84d98356-822f-4f98-8fac-a1854449ad01 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:25.700822 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84d98356-822f-4f98-8fac-a1854449ad01 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:25.701272 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84d98356-822f-4f98-8fac-a1854449ad01 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:25.701700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84d98356-822f-4f98-8fac-a1854449ad01 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:25.836171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-84d98356-822f-4f98-8fac-a1854449ad01 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:25.844060 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-84d98356-822f-4f98-8fac-a1854449ad01 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1516 microversion: 2.1 time: 0.159338 Sep 15 19:35:25.844632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 688/957] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:25 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:26.010374 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-3349bf86-2612-4c91-bd0e-58db839dabc2 req-33674fa9-d53d-4d01-b2ba-6d92ac82bc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1a7eec-51a4-496a-a361-cb2e7f0b6f65", "name": "network-vif-unplugged", "status": "completed", "tag": "5d9355ed-482e-4597-88f4-9572e304ef13"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:35:26.021590 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-3349bf86-2612-4c91-bd0e-58db839dabc2 req-33674fa9-d53d-4d01-b2ba-6d92ac82bc0b service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:26.022114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-3349bf86-2612-4c91-bd0e-58db839dabc2 req-33674fa9-d53d-4d01-b2ba-6d92ac82bc0b service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:26.022584 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-3349bf86-2612-4c91-bd0e-58db839dabc2 req-33674fa9-d53d-4d01-b2ba-6d92ac82bc0b service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:26.034163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.compute.server_external_events [req-3349bf86-2612-4c91-bd0e-58db839dabc2 req-33674fa9-d53d-4d01-b2ba-6d92ac82bc0b service nova] Unable to find a host for instance eb1a7eec-51a4-496a-a361-cb2e7f0b6f65. Dropping event network-vif-unplugged {{(pid=121041) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 15 19:35:26.035628 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-3349bf86-2612-4c91-bd0e-58db839dabc2 req-33674fa9-d53d-4d01-b2ba-6d92ac82bc0b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029056 Sep 15 19:35:26.036403 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 689/958] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 15 19:35:26.867762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-90d47f98-413c-4131-ad49-702cc887dc0e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:26.868451 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-90d47f98-413c-4131-ad49-702cc887dc0e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:26.875447 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90d47f98-413c-4131-ad49-702cc887dc0e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:26.875953 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90d47f98-413c-4131-ad49-702cc887dc0e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:26.876383 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90d47f98-413c-4131-ad49-702cc887dc0e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:26.877067 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90d47f98-413c-4131-ad49-702cc887dc0e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:26.877510 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90d47f98-413c-4131-ad49-702cc887dc0e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:26.877927 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90d47f98-413c-4131-ad49-702cc887dc0e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:27.058609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-90d47f98-413c-4131-ad49-702cc887dc0e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:27.068108 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-90d47f98-413c-4131-ad49-702cc887dc0e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1516 microversion: 2.1 time: 0.204083 Sep 15 19:35:27.069256 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 690/959] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:26 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:28.092037 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e0d02ff1-065e-4142-a15c-14644ba082a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:28.092663 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e0d02ff1-065e-4142-a15c-14644ba082a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:28.099745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e0d02ff1-065e-4142-a15c-14644ba082a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:28.100233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e0d02ff1-065e-4142-a15c-14644ba082a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:28.100709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e0d02ff1-065e-4142-a15c-14644ba082a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:28.101409 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e0d02ff1-065e-4142-a15c-14644ba082a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:28.101864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e0d02ff1-065e-4142-a15c-14644ba082a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:28.102296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e0d02ff1-065e-4142-a15c-14644ba082a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:28.238679 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e0d02ff1-065e-4142-a15c-14644ba082a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:28.242260 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:35:28.246991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e0d02ff1-065e-4142-a15c-14644ba082a8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1518 microversion: 2.1 time: 0.159016 Sep 15 19:35:28.250459 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 691/960] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:28 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:29.271525 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4cd8c0e1-3128-49fb-91f9-37a82a3e99db tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:29.272237 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4cd8c0e1-3128-49fb-91f9-37a82a3e99db tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:29.280956 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4cd8c0e1-3128-49fb-91f9-37a82a3e99db tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:29.281296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4cd8c0e1-3128-49fb-91f9-37a82a3e99db tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:29.281734 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4cd8c0e1-3128-49fb-91f9-37a82a3e99db tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:29.282816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4cd8c0e1-3128-49fb-91f9-37a82a3e99db tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:29.282920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4cd8c0e1-3128-49fb-91f9-37a82a3e99db tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:29.283281 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4cd8c0e1-3128-49fb-91f9-37a82a3e99db tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:29.490595 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4cd8c0e1-3128-49fb-91f9-37a82a3e99db tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:29.498974 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4cd8c0e1-3128-49fb-91f9-37a82a3e99db tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.232067 Sep 15 19:35:29.499598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 692/961] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:29 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:30.523056 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c5c2a43f-6a86-43b6-8e61-c5071f5a3ded tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:30.523745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c5c2a43f-6a86-43b6-8e61-c5071f5a3ded tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:30.530402 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5c2a43f-6a86-43b6-8e61-c5071f5a3ded tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:30.530860 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5c2a43f-6a86-43b6-8e61-c5071f5a3ded tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:30.531287 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5c2a43f-6a86-43b6-8e61-c5071f5a3ded tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:30.531999 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5c2a43f-6a86-43b6-8e61-c5071f5a3ded tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:30.532473 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5c2a43f-6a86-43b6-8e61-c5071f5a3ded tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:30.532890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5c2a43f-6a86-43b6-8e61-c5071f5a3ded tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:30.667676 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c5c2a43f-6a86-43b6-8e61-c5071f5a3ded tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:30.676088 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c5c2a43f-6a86-43b6-8e61-c5071f5a3ded tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.156389 Sep 15 19:35:30.676659 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 693/962] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:30 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:31.700276 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-97530a7a-9d5f-42b2-a0e0-b7662fcfe0b5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:31.700929 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-97530a7a-9d5f-42b2-a0e0-b7662fcfe0b5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:31.707459 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97530a7a-9d5f-42b2-a0e0-b7662fcfe0b5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:31.707962 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97530a7a-9d5f-42b2-a0e0-b7662fcfe0b5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:31.708433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97530a7a-9d5f-42b2-a0e0-b7662fcfe0b5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:31.709114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97530a7a-9d5f-42b2-a0e0-b7662fcfe0b5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:31.709561 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97530a7a-9d5f-42b2-a0e0-b7662fcfe0b5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:31.709980 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97530a7a-9d5f-42b2-a0e0-b7662fcfe0b5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:31.842618 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-97530a7a-9d5f-42b2-a0e0-b7662fcfe0b5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:31.850904 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-97530a7a-9d5f-42b2-a0e0-b7662fcfe0b5 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.154704 Sep 15 19:35:31.851507 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 694/963] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:31 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:32.874507 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-262a8fa6-fbb7-4298-886b-447f7a4714ec tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:32.875035 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-262a8fa6-fbb7-4298-886b-447f7a4714ec tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:32.882285 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-262a8fa6-fbb7-4298-886b-447f7a4714ec tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:32.882759 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-262a8fa6-fbb7-4298-886b-447f7a4714ec tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:32.883204 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-262a8fa6-fbb7-4298-886b-447f7a4714ec tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:32.883953 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-262a8fa6-fbb7-4298-886b-447f7a4714ec tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:32.884409 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-262a8fa6-fbb7-4298-886b-447f7a4714ec tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:32.884834 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-262a8fa6-fbb7-4298-886b-447f7a4714ec tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:33.060818 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-262a8fa6-fbb7-4298-886b-447f7a4714ec tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:33.069513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-262a8fa6-fbb7-4298-886b-447f7a4714ec tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.199050 Sep 15 19:35:33.070119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 695/964] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:32 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:34.093025 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7e95c7ed-0500-45ca-92cb-c15f14f5266e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:34.093643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7e95c7ed-0500-45ca-92cb-c15f14f5266e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:34.100806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e95c7ed-0500-45ca-92cb-c15f14f5266e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:34.101270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e95c7ed-0500-45ca-92cb-c15f14f5266e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:34.101709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e95c7ed-0500-45ca-92cb-c15f14f5266e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:34.102430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e95c7ed-0500-45ca-92cb-c15f14f5266e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:34.102860 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e95c7ed-0500-45ca-92cb-c15f14f5266e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:34.103282 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e95c7ed-0500-45ca-92cb-c15f14f5266e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:34.248242 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7e95c7ed-0500-45ca-92cb-c15f14f5266e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:34.256580 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7e95c7ed-0500-45ca-92cb-c15f14f5266e tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.167481 Sep 15 19:35:34.257158 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 696/965] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:34 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:35.280773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-800fe4d7-ce16-4174-91c7-5f63be844f4d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:35.281397 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-800fe4d7-ce16-4174-91c7-5f63be844f4d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:35.288597 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-800fe4d7-ce16-4174-91c7-5f63be844f4d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:35.289074 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-800fe4d7-ce16-4174-91c7-5f63be844f4d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:35.289507 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-800fe4d7-ce16-4174-91c7-5f63be844f4d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:35.290196 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-800fe4d7-ce16-4174-91c7-5f63be844f4d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:35.290648 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-800fe4d7-ce16-4174-91c7-5f63be844f4d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:35.291068 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-800fe4d7-ce16-4174-91c7-5f63be844f4d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:35.422773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-800fe4d7-ce16-4174-91c7-5f63be844f4d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:35.430505 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-800fe4d7-ce16-4174-91c7-5f63be844f4d tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.153805 Sep 15 19:35:35.431073 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 697/966] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:35 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:36.454569 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0a2800f6-1eb3-475c-baa5-92cd98c9be10 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:36.455252 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0a2800f6-1eb3-475c-baa5-92cd98c9be10 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:36.461609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a2800f6-1eb3-475c-baa5-92cd98c9be10 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:36.462087 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a2800f6-1eb3-475c-baa5-92cd98c9be10 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:36.462522 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a2800f6-1eb3-475c-baa5-92cd98c9be10 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:36.463277 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a2800f6-1eb3-475c-baa5-92cd98c9be10 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:36.463749 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a2800f6-1eb3-475c-baa5-92cd98c9be10 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:36.464171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a2800f6-1eb3-475c-baa5-92cd98c9be10 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:36.601794 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0a2800f6-1eb3-475c-baa5-92cd98c9be10 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:36.612007 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0a2800f6-1eb3-475c-baa5-92cd98c9be10 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.161523 Sep 15 19:35:36.612877 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 698/967] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:36 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:37.640668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a0f81bfb-45fd-40f4-a681-d8e01eda5165 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:37.641265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a0f81bfb-45fd-40f4-a681-d8e01eda5165 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:37.651546 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0f81bfb-45fd-40f4-a681-d8e01eda5165 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:37.652059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0f81bfb-45fd-40f4-a681-d8e01eda5165 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:37.652512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0f81bfb-45fd-40f4-a681-d8e01eda5165 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:37.653217 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0f81bfb-45fd-40f4-a681-d8e01eda5165 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:37.653663 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0f81bfb-45fd-40f4-a681-d8e01eda5165 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:37.654085 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0f81bfb-45fd-40f4-a681-d8e01eda5165 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:37.793800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a0f81bfb-45fd-40f4-a681-d8e01eda5165 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:37.801830 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a0f81bfb-45fd-40f4-a681-d8e01eda5165 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.164963 Sep 15 19:35:37.805329 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 699/968] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:37 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:35:38.825767 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c014ba2d-ee6a-4ece-90a4-3223aca245d2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:38.826429 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c014ba2d-ee6a-4ece-90a4-3223aca245d2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:38.833970 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c014ba2d-ee6a-4ece-90a4-3223aca245d2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:38.834455 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c014ba2d-ee6a-4ece-90a4-3223aca245d2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:38.834914 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c014ba2d-ee6a-4ece-90a4-3223aca245d2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:38.835593 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c014ba2d-ee6a-4ece-90a4-3223aca245d2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:38.836096 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c014ba2d-ee6a-4ece-90a4-3223aca245d2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:38.836515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c014ba2d-ee6a-4ece-90a4-3223aca245d2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:38.975435 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c014ba2d-ee6a-4ece-90a4-3223aca245d2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:38.983369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c014ba2d-ee6a-4ece-90a4-3223aca245d2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.161537 Sep 15 19:35:38.984005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 700/969] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:38 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:40.007837 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-71c48d64-4f7d-4858-b56e-518c2a025cb2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:40.008510 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-71c48d64-4f7d-4858-b56e-518c2a025cb2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:40.015132 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71c48d64-4f7d-4858-b56e-518c2a025cb2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:40.015626 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71c48d64-4f7d-4858-b56e-518c2a025cb2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:40.016095 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71c48d64-4f7d-4858-b56e-518c2a025cb2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:40.016805 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71c48d64-4f7d-4858-b56e-518c2a025cb2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:40.017250 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71c48d64-4f7d-4858-b56e-518c2a025cb2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:40.017673 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71c48d64-4f7d-4858-b56e-518c2a025cb2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:40.174370 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-71c48d64-4f7d-4858-b56e-518c2a025cb2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:40.183151 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-71c48d64-4f7d-4858-b56e-518c2a025cb2 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.179420 Sep 15 19:35:40.183674 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 701/970] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:40 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:41.208223 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c26ec5ec-edbf-4371-b760-87eb00295e9b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:41.208875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c26ec5ec-edbf-4371-b760-87eb00295e9b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:41.215294 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c26ec5ec-edbf-4371-b760-87eb00295e9b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:41.215805 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c26ec5ec-edbf-4371-b760-87eb00295e9b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:41.216245 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c26ec5ec-edbf-4371-b760-87eb00295e9b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:41.216935 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c26ec5ec-edbf-4371-b760-87eb00295e9b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:41.217383 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c26ec5ec-edbf-4371-b760-87eb00295e9b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:41.217803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c26ec5ec-edbf-4371-b760-87eb00295e9b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:41.351119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c26ec5ec-edbf-4371-b760-87eb00295e9b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:41.359163 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c26ec5ec-edbf-4371-b760-87eb00295e9b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.155436 Sep 15 19:35:41.359762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 702/971] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:41 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:42.382470 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8fc37cfb-e3b0-4bb4-bddd-01998e24cb39 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:42.383349 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8fc37cfb-e3b0-4bb4-bddd-01998e24cb39 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:42.385466 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:35:42.390228 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8fc37cfb-e3b0-4bb4-bddd-01998e24cb39 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:42.390701 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8fc37cfb-e3b0-4bb4-bddd-01998e24cb39 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:42.391134 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8fc37cfb-e3b0-4bb4-bddd-01998e24cb39 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:42.391883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8fc37cfb-e3b0-4bb4-bddd-01998e24cb39 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:42.392305 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8fc37cfb-e3b0-4bb4-bddd-01998e24cb39 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:42.399286 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8fc37cfb-e3b0-4bb4-bddd-01998e24cb39 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:42.526582 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8fc37cfb-e3b0-4bb4-bddd-01998e24cb39 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:42.534499 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8fc37cfb-e3b0-4bb4-bddd-01998e24cb39 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.155988 Sep 15 19:35:42.535079 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 703/972] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:42 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:43.122854 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-6d0995be-cd20-41bf-aa9c-7407a9b40586 req-4a2eaed6-a50a-468a-b1bb-46ead0cb09e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1a7eec-51a4-496a-a361-cb2e7f0b6f65", "name": "network-vif-plugged", "status": "completed", "tag": "5d9355ed-482e-4597-88f4-9572e304ef13"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:35:43.133040 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-6d0995be-cd20-41bf-aa9c-7407a9b40586 req-4a2eaed6-a50a-468a-b1bb-46ead0cb09e1 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:43.133510 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-6d0995be-cd20-41bf-aa9c-7407a9b40586 req-4a2eaed6-a50a-468a-b1bb-46ead0cb09e1 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:43.133935 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-6d0995be-cd20-41bf-aa9c-7407a9b40586 req-4a2eaed6-a50a-468a-b1bb-46ead0cb09e1 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:43.144587 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-6d0995be-cd20-41bf-aa9c-7407a9b40586 req-4a2eaed6-a50a-468a-b1bb-46ead0cb09e1 service nova] Creating event network-vif-plugged:5d9355ed-482e-4597-88f4-9572e304ef13 for instance eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 on hv-cinder-84984 Sep 15 19:35:43.150555 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-6d0995be-cd20-41bf-aa9c-7407a9b40586 req-4a2eaed6-a50a-468a-b1bb-46ead0cb09e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031308 Sep 15 19:35:43.151171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 704/973] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:35:43.559504 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fd785d68-26c5-4477-a556-a41e6a2434e8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:43.560235 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fd785d68-26c5-4477-a556-a41e6a2434e8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:43.566655 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd785d68-26c5-4477-a556-a41e6a2434e8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:43.569155 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd785d68-26c5-4477-a556-a41e6a2434e8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:43.569155 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd785d68-26c5-4477-a556-a41e6a2434e8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:43.569155 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd785d68-26c5-4477-a556-a41e6a2434e8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:43.569488 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd785d68-26c5-4477-a556-a41e6a2434e8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:43.569755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd785d68-26c5-4477-a556-a41e6a2434e8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:43.700215 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fd785d68-26c5-4477-a556-a41e6a2434e8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:43.708002 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fd785d68-26c5-4477-a556-a41e6a2434e8 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.153147 Sep 15 19:35:43.708602 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 705/974] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:43 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:35:44.731192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0486aef5-c93f-4d74-89cb-da916e2d4b1a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:44.731892 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0486aef5-c93f-4d74-89cb-da916e2d4b1a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:44.738336 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0486aef5-c93f-4d74-89cb-da916e2d4b1a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:44.738814 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0486aef5-c93f-4d74-89cb-da916e2d4b1a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:44.739249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0486aef5-c93f-4d74-89cb-da916e2d4b1a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:44.739963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0486aef5-c93f-4d74-89cb-da916e2d4b1a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:44.740428 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0486aef5-c93f-4d74-89cb-da916e2d4b1a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:44.740832 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0486aef5-c93f-4d74-89cb-da916e2d4b1a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:44.882507 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0486aef5-c93f-4d74-89cb-da916e2d4b1a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:44.890448 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0486aef5-c93f-4d74-89cb-da916e2d4b1a tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1574 microversion: 2.1 time: 0.163261 Sep 15 19:35:44.891031 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 706/975] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:44 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:45.921609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c619f0bd-62d0-41c7-8f19-a38c322dc33b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:45.922299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c619f0bd-62d0-41c7-8f19-a38c322dc33b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:45.929015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c619f0bd-62d0-41c7-8f19-a38c322dc33b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:45.929498 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c619f0bd-62d0-41c7-8f19-a38c322dc33b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:45.930007 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c619f0bd-62d0-41c7-8f19-a38c322dc33b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:45.930652 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c619f0bd-62d0-41c7-8f19-a38c322dc33b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:45.931072 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c619f0bd-62d0-41c7-8f19-a38c322dc33b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:45.931542 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c619f0bd-62d0-41c7-8f19-a38c322dc33b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:46.106852 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c619f0bd-62d0-41c7-8f19-a38c322dc33b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:46.116544 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c619f0bd-62d0-41c7-8f19-a38c322dc33b tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1561 microversion: 2.1 time: 0.198785 Sep 15 19:35:46.117175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 707/976] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:35:45 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1561 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:55.569224 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bd1b5753-08fb-461b-92a0-c3fe50a7ef05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:55.569903 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bd1b5753-08fb-461b-92a0-c3fe50a7ef05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:55.576805 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bd1b5753-08fb-461b-92a0-c3fe50a7ef05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:55.577295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bd1b5753-08fb-461b-92a0-c3fe50a7ef05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:55.577763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bd1b5753-08fb-461b-92a0-c3fe50a7ef05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:55.578562 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bd1b5753-08fb-461b-92a0-c3fe50a7ef05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:55.579114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bd1b5753-08fb-461b-92a0-c3fe50a7ef05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:55.579543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bd1b5753-08fb-461b-92a0-c3fe50a7ef05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:55.611575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bd1b5753-08fb-461b-92a0-c3fe50a7ef05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-volume_attachments/57123e2c-442e-4e6e-994f-94ac75f36207" status: 200 len: 194 microversion: 2.20 time: 0.047461 Sep 15 19:35:55.612215 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 708/977] 10.222.0.18 () {60 vars in 1454 bytes} [Thu Sep 15 19:35:55 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-volume_attachments/57123e2c-442e-4e6e-994f-94ac75f36207 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 19:35:55.682852 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a85e5fde-b1f6-4a25-b0b2-1c25630eb8fb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:55.683342 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a85e5fde-b1f6-4a25-b0b2-1c25630eb8fb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:55.689317 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a85e5fde-b1f6-4a25-b0b2-1c25630eb8fb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:55.690046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a85e5fde-b1f6-4a25-b0b2-1c25630eb8fb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:55.690471 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a85e5fde-b1f6-4a25-b0b2-1c25630eb8fb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:55.691221 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a85e5fde-b1f6-4a25-b0b2-1c25630eb8fb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:55.691695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a85e5fde-b1f6-4a25-b0b2-1c25630eb8fb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:55.692126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a85e5fde-b1f6-4a25-b0b2-1c25630eb8fb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:55.696649 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:35:55.772605 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-a85e5fde-b1f6-4a25-b0b2-1c25630eb8fb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lazy-loading 'services' on Instance uuid f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:35:56.035634 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a85e5fde-b1f6-4a25-b0b2-1c25630eb8fb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-volume_attachments/57123e2c-442e-4e6e-994f-94ac75f36207" status: 202 len: 0 microversion: 2.20 time: 0.356637 Sep 15 19:35:56.036273 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 709/978] 10.222.0.18 () {60 vars in 1457 bytes} [Thu Sep 15 19:35:55 2022] DELETE /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-volume_attachments/57123e2c-442e-4e6e-994f-94ac75f36207 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 19:35:56.045562 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f9a21863-d939-4d81-9945-db5a28ac27aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:56.047828 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f9a21863-d939-4d81-9945-db5a28ac27aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:56.054707 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f9a21863-d939-4d81-9945-db5a28ac27aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:56.055190 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f9a21863-d939-4d81-9945-db5a28ac27aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:56.055627 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f9a21863-d939-4d81-9945-db5a28ac27aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:56.056356 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f9a21863-d939-4d81-9945-db5a28ac27aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:56.056813 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f9a21863-d939-4d81-9945-db5a28ac27aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:56.057236 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f9a21863-d939-4d81-9945-db5a28ac27aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:56.089442 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f9a21863-d939-4d81-9945-db5a28ac27aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047840 Sep 15 19:35:56.090019 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 710/979] 10.222.0.18 () {60 vars in 1343 bytes} [Thu Sep 15 19:35:56 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 19:35:57.104285 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a8c48da4-6395-4e41-8e3f-0a307f0a0ab4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:57.108854 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a8c48da4-6395-4e41-8e3f-0a307f0a0ab4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:57.116288 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8c48da4-6395-4e41-8e3f-0a307f0a0ab4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:57.116910 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8c48da4-6395-4e41-8e3f-0a307f0a0ab4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:57.117724 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8c48da4-6395-4e41-8e3f-0a307f0a0ab4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:57.118515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8c48da4-6395-4e41-8e3f-0a307f0a0ab4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:57.118966 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8c48da4-6395-4e41-8e3f-0a307f0a0ab4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:57.119383 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8c48da4-6395-4e41-8e3f-0a307f0a0ab4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:57.154393 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a8c48da4-6395-4e41-8e3f-0a307f0a0ab4 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054770 Sep 15 19:35:57.154978 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 711/980] 10.222.0.18 () {60 vars in 1343 bytes} [Thu Sep 15 19:35:57 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 19:35:58.170219 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-74d24ad5-5b45-41d4-a9c4-3e22c5d7a10d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:58.175154 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-74d24ad5-5b45-41d4-a9c4-3e22c5d7a10d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:58.186754 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-74d24ad5-5b45-41d4-a9c4-3e22c5d7a10d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:58.187249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-74d24ad5-5b45-41d4-a9c4-3e22c5d7a10d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:58.187700 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-74d24ad5-5b45-41d4-a9c4-3e22c5d7a10d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:58.188408 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-74d24ad5-5b45-41d4-a9c4-3e22c5d7a10d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:58.188858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-74d24ad5-5b45-41d4-a9c4-3e22c5d7a10d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:58.189288 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-74d24ad5-5b45-41d4-a9c4-3e22c5d7a10d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:58.221789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-74d24ad5-5b45-41d4-a9c4-3e22c5d7a10d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055752 Sep 15 19:35:58.222366 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 712/981] 10.222.0.18 () {60 vars in 1343 bytes} [Thu Sep 15 19:35:58 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:35:58.290344 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-747e3a58-f79e-4c2b-8629-c34f4324d250 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:58.290879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-747e3a58-f79e-4c2b-8629-c34f4324d250 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:58.297521 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-747e3a58-f79e-4c2b-8629-c34f4324d250 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:58.298441 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-747e3a58-f79e-4c2b-8629-c34f4324d250 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:58.301962 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-747e3a58-f79e-4c2b-8629-c34f4324d250 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:58.301962 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-747e3a58-f79e-4c2b-8629-c34f4324d250 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:58.301962 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-747e3a58-f79e-4c2b-8629-c34f4324d250 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:58.301962 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-747e3a58-f79e-4c2b-8629-c34f4324d250 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:58.327606 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-747e3a58-f79e-4c2b-8629-c34f4324d250 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:35:58.839398 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-747e3a58-f79e-4c2b-8629-c34f4324d250 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 204 len: 0 microversion: 2.20 time: 0.552935 Sep 15 19:35:58.840033 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 713/982] 10.222.0.18 () {60 vars in 1280 bytes} [Thu Sep 15 19:35:58 2022] DELETE /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 15 19:35:58.857446 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e0d2a945-07f0-4a93-90b4-938b8a80148f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:35:58.858153 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e0d2a945-07f0-4a93-90b4-938b8a80148f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:35:58.864628 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e0d2a945-07f0-4a93-90b4-938b8a80148f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:58.865113 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e0d2a945-07f0-4a93-90b4-938b8a80148f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:58.865552 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e0d2a945-07f0-4a93-90b4-938b8a80148f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:58.866280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e0d2a945-07f0-4a93-90b4-938b8a80148f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:35:58.866726 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e0d2a945-07f0-4a93-90b4-938b8a80148f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:35:58.867133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e0d2a945-07f0-4a93-90b4-938b8a80148f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:35:59.062631 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e0d2a945-07f0-4a93-90b4-938b8a80148f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:59.072119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e0d2a945-07f0-4a93-90b4-938b8a80148f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:59.073726 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e0d2a945-07f0-4a93-90b4-938b8a80148f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:35:59.075311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e0d2a945-07f0-4a93-90b4-938b8a80148f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1722 microversion: 2.20 time: 0.221905 Sep 15 19:35:59.075864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 714/983] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:35:58 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:00.101341 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0b852cbf-0e37-49f8-91ad-143e891c4d6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:00.101948 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0b852cbf-0e37-49f8-91ad-143e891c4d6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:00.108719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b852cbf-0e37-49f8-91ad-143e891c4d6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:00.109193 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b852cbf-0e37-49f8-91ad-143e891c4d6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:00.109621 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b852cbf-0e37-49f8-91ad-143e891c4d6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:00.110318 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b852cbf-0e37-49f8-91ad-143e891c4d6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:00.110763 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b852cbf-0e37-49f8-91ad-143e891c4d6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:00.111178 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b852cbf-0e37-49f8-91ad-143e891c4d6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:00.266666 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0b852cbf-0e37-49f8-91ad-143e891c4d6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:00.277808 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0b852cbf-0e37-49f8-91ad-143e891c4d6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:00.279279 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0b852cbf-0e37-49f8-91ad-143e891c4d6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:00.280562 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0b852cbf-0e37-49f8-91ad-143e891c4d6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1722 microversion: 2.20 time: 0.183600 Sep 15 19:36:00.281126 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 715/984] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:00 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:01.321474 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9737816b-2528-498e-a363-0038cf5d4367 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:01.322376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9737816b-2528-498e-a363-0038cf5d4367 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:01.329829 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9737816b-2528-498e-a363-0038cf5d4367 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:01.338315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9737816b-2528-498e-a363-0038cf5d4367 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:01.338315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9737816b-2528-498e-a363-0038cf5d4367 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:01.338315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9737816b-2528-498e-a363-0038cf5d4367 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:01.338315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9737816b-2528-498e-a363-0038cf5d4367 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:01.338734 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9737816b-2528-498e-a363-0038cf5d4367 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:01.597613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9737816b-2528-498e-a363-0038cf5d4367 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:01.607299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9737816b-2528-498e-a363-0038cf5d4367 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:01.609155 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9737816b-2528-498e-a363-0038cf5d4367 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:01.610558 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9737816b-2528-498e-a363-0038cf5d4367 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1654 microversion: 2.20 time: 0.306381 Sep 15 19:36:01.611153 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 716/985] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:01 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1654 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:01.826512 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-2c8980d4-a1c0-4b13-828d-9cb9038ae2c5 req-8d4f6d80-2d84-445e-b73f-c5cdf6b33dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4", "name": "network-vif-deleted", "tag": "143ce322-19a2-43c5-83ec-ba67ce8ce7cc"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:36:01.837312 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2c8980d4-a1c0-4b13-828d-9cb9038ae2c5 req-8d4f6d80-2d84-445e-b73f-c5cdf6b33dc4 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:01.837917 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2c8980d4-a1c0-4b13-828d-9cb9038ae2c5 req-8d4f6d80-2d84-445e-b73f-c5cdf6b33dc4 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:01.838592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2c8980d4-a1c0-4b13-828d-9cb9038ae2c5 req-8d4f6d80-2d84-445e-b73f-c5cdf6b33dc4 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:01.850683 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-2c8980d4-a1c0-4b13-828d-9cb9038ae2c5 req-8d4f6d80-2d84-445e-b73f-c5cdf6b33dc4 service nova] Creating event network-vif-deleted:143ce322-19a2-43c5-83ec-ba67ce8ce7cc for instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 on hv-cinder-84984 Sep 15 19:36:01.855817 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-2c8980d4-a1c0-4b13-828d-9cb9038ae2c5 req-8d4f6d80-2d84-445e-b73f-c5cdf6b33dc4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033555 Sep 15 19:36:01.856555 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 717/986] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:36:02.638199 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:02.638978 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:02.645514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:02.646098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:02.647165 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:02.647908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:02.648359 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:02.648780 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:02.681685 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:02.682158 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:02.682588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:02.683037 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lazy-loading 'fault' on Instance uuid f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:36:02.732407 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:02.742310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:02.744664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:02.746798 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d232ac0e-c501-48ab-a367-37ba1ecd4d5d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1371 microversion: 2.20 time: 0.113440 Sep 15 19:36:02.747803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 718/987] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:02 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:03.772965 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:03.773595 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:03.780114 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:03.780595 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:03.781037 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:03.781728 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:03.782180 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:03.782603 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:03.814136 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:03.814890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:03.815324 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:03.815798 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lazy-loading 'fault' on Instance uuid f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:36:03.856043 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:03.864167 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:03.865618 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:03.866758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-da2d280f-8f2d-42e9-b298-e1027d0a7e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 200 len: 1371 microversion: 2.20 time: 0.098292 Sep 15 19:36:03.867310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 719/988] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:03 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:04.890638 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b197fbf7-49d7-482b-a3bc-c48f3d90fe4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:04.891333 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b197fbf7-49d7-482b-a3bc-c48f3d90fe4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:04.898080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b197fbf7-49d7-482b-a3bc-c48f3d90fe4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:04.898514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b197fbf7-49d7-482b-a3bc-c48f3d90fe4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:04.898961 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b197fbf7-49d7-482b-a3bc-c48f3d90fe4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:04.899692 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b197fbf7-49d7-482b-a3bc-c48f3d90fe4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:04.900182 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b197fbf7-49d7-482b-a3bc-c48f3d90fe4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:04.900613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b197fbf7-49d7-482b-a3bc-c48f3d90fe4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:04.915864 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-b197fbf7-49d7-482b-a3bc-c48f3d90fe4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] HTTP exception thrown: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b197fbf7-49d7-482b-a3bc-c48f3d90fe4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Request method failure captured: Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 HTTP/1.1 Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI33t9Ff3TC6CaCfsx0czw0aBn8SD971R6_ioWsuVVpNi0zF2ESYXoxIEUvDbAOOWHRzz6oHuCdf4_2RqqNhP9mQ77-EY60fPpMohdukHLgEyEJbXI4R1rkdi1l6pQ2kJrSca9C5Bbpsq4E43x0mAZRVDcBBcWGVxYLA04vtN3Vi6GMI Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 427b697da1034408811e994e22d4f592 Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:36:04.917579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:36:04.919405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_427b697da1034408811e994e22d4f592", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/427b697da1034408811e994e22d4f592"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/427b697da1034408811e994e22d4f592"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/427b697da1034408811e994e22d4f592"}]}] Sep 15 19:36:04.919405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:36:04.919405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 427b697da1034408811e994e22d4f592 Sep 15 19:36:04.919405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:36:04.919405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeShelveTestJSON-357440265-project Sep 15 19:36:04.919405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:36:04.919405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:36:04.919405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 250673e17f40455ca2c5e0036f5a9e3c Sep 15 19:36:04.919405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeShelveTestJSON-357440265-project Sep 15 19:36:04.919405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:36:04.919405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:36:04.919405 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4'} Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:36:04.920469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:36:04.922016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:36:04.923223 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b197fbf7-49d7-482b-a3bc-c48f3d90fe4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Returning 404 to user: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:36:04.923223 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b197fbf7-49d7-482b-a3bc-c48f3d90fe4d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 404 len: 111 microversion: 2.20 time: 0.032372 Sep 15 19:36:04.923223 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 720/989] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:04 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 15 19:36:04.932323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9518b5e2-a6c5-4f15-a546-d95769aa7f07 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '.version_select at 0x7f551eb97a60>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:05.035033 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9518b5e2-a6c5-4f15-a546-d95769aa7f07 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643718889" status: 204 len: 0 microversion: 2.20 time: 0.110081 Sep 15 19:36:05.040104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 721/990] 10.222.0.18 () {60 vars in 1262 bytes} [Thu Sep 15 19:36:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643718889 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 15 19:36:05.920709 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ba23fa3b-3823-4e1e-b1fa-45f58eeb4e0b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Action: 'create', calling method: .version_select at 0x7f551e9d7310>, body: {"keypair": {"name": "tempest-keypair-754287024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn+VfC5QNYpbSwpIzWRGNbDlQhJEJ7A3YVnZit5r7GA44KVaX1NjDImx5SgtYv4Gfk73E+ug96qR2448a/a6gw/ddP4jENuhQYxHEzM1mER8z6gsHox44sT7kzd2TJs0w=="}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:36:05.939339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-ba23fa3b-3823-4e1e-b1fa-45f58eeb4e0b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Getting quotas for project 427b697da1034408811e994e22d4f592. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:36:05.944526 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-ba23fa3b-3823-4e1e-b1fa-45f58eeb4e0b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Getting quotas for user 250673e17f40455ca2c5e0036f5a9e3c and project 427b697da1034408811e994e22d4f592. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:36:06.080611 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ba23fa3b-3823-4e1e-b1fa-45f58eeb4e0b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.163642 Sep 15 19:36:06.081153 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 722/991] 10.222.0.18 () {62 vars in 1200 bytes} [Thu Sep 15 19:36:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 15 19:36:08.850530 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-4732310", "imageRef": "e2ffbd99-9d19-4285-9257-073acda35940", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fec50405-c88e-450d-9ebf-156c556a1bf0"}], "security_groups": [{"name": "tempest-securitygroup--434487569"}], "key_name": "tempest-keypair-754287024", "user_data": "}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:36:08.960119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] validate_networks() for [('fec50405-c88e-450d-9ebf-156c556a1bf0', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 19:36:09.356716 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 19:36:09.357154 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 19:36:09.357644 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 19:36:09.358058 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 19:36:09.358482 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 19:36:09.367513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:09.368061 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:09.368498 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:09.369281 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:09.369741 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:09.370173 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:09.388715 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Getting quotas for project 427b697da1034408811e994e22d4f592. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 19:36:09.393326 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Getting quotas for user 250673e17f40455ca2c5e0036f5a9e3c and project 427b697da1034408811e994e22d4f592. Resources: {'instances', 'ram', 'cores'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 19:36:09.406347 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 19:36:09.408848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2ffbd99-9d19-4285-9257-073acda35940',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 19:36:09.574723 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b31abc8f-003e-4d99-8bd1-841e1ac2d78a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.729736 Sep 15 19:36:09.575488 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 723/992] 10.222.0.18 () {62 vars in 1188 bytes} [Thu Sep 15 19:36:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 15 19:36:09.588707 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2425b5fd-838b-4435-9f5c-4f0628656ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:09.589327 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2425b5fd-838b-4435-9f5c-4f0628656ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:09.649089 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2425b5fd-838b-4435-9f5c-4f0628656ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:09.658545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2425b5fd-838b-4435-9f5c-4f0628656ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:09.660046 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2425b5fd-838b-4435-9f5c-4f0628656ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:09.661184 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2425b5fd-838b-4435-9f5c-4f0628656ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1278 microversion: 2.20 time: 0.077028 Sep 15 19:36:09.662000 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 724/993] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:09 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1278 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:10.686311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d68112b3-5c71-4d67-9c87-9b6ff65d07c8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:10.686986 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d68112b3-5c71-4d67-9c87-9b6ff65d07c8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:10.693959 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d68112b3-5c71-4d67-9c87-9b6ff65d07c8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:10.694494 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d68112b3-5c71-4d67-9c87-9b6ff65d07c8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:10.695049 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d68112b3-5c71-4d67-9c87-9b6ff65d07c8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:10.695661 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d68112b3-5c71-4d67-9c87-9b6ff65d07c8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:10.696168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d68112b3-5c71-4d67-9c87-9b6ff65d07c8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:10.696536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d68112b3-5c71-4d67-9c87-9b6ff65d07c8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:10.760838 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d68112b3-5c71-4d67-9c87-9b6ff65d07c8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:10.769631 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d68112b3-5c71-4d67-9c87-9b6ff65d07c8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:10.771025 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d68112b3-5c71-4d67-9c87-9b6ff65d07c8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:10.772755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d68112b3-5c71-4d67-9c87-9b6ff65d07c8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1282 microversion: 2.20 time: 0.090436 Sep 15 19:36:10.773578 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 725/994] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:10 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:11.799124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2df9436c-1095-411a-9fb1-d94f06b0a31f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:11.799807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2df9436c-1095-411a-9fb1-d94f06b0a31f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:11.807139 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2df9436c-1095-411a-9fb1-d94f06b0a31f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:11.807626 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2df9436c-1095-411a-9fb1-d94f06b0a31f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:11.808096 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2df9436c-1095-411a-9fb1-d94f06b0a31f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:11.808797 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2df9436c-1095-411a-9fb1-d94f06b0a31f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:11.809255 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2df9436c-1095-411a-9fb1-d94f06b0a31f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:11.809684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2df9436c-1095-411a-9fb1-d94f06b0a31f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:11.876093 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2df9436c-1095-411a-9fb1-d94f06b0a31f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:11.889650 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2df9436c-1095-411a-9fb1-d94f06b0a31f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:11.891094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2df9436c-1095-411a-9fb1-d94f06b0a31f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:11.892213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2df9436c-1095-411a-9fb1-d94f06b0a31f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1330 microversion: 2.20 time: 0.097069 Sep 15 19:36:11.892764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 726/995] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:11 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:12.917954 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1b1dacb7-7628-4754-bc9f-662958c11a0a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:12.918662 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1b1dacb7-7628-4754-bc9f-662958c11a0a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:12.921119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:36:12.925913 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b1dacb7-7628-4754-bc9f-662958c11a0a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:12.926390 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b1dacb7-7628-4754-bc9f-662958c11a0a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:12.926821 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b1dacb7-7628-4754-bc9f-662958c11a0a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:12.927523 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b1dacb7-7628-4754-bc9f-662958c11a0a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:12.927991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b1dacb7-7628-4754-bc9f-662958c11a0a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:12.928408 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b1dacb7-7628-4754-bc9f-662958c11a0a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:12.992511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1b1dacb7-7628-4754-bc9f-662958c11a0a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:12.996565 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:36:13.001604 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1b1dacb7-7628-4754-bc9f-662958c11a0a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:13.003051 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1b1dacb7-7628-4754-bc9f-662958c11a0a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:13.004194 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1b1dacb7-7628-4754-bc9f-662958c11a0a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1330 microversion: 2.20 time: 0.090280 Sep 15 19:36:13.004744 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 727/996] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:12 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1330 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:14.030020 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5ebaef65-ea76-4ac1-bdd7-15001868e551 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:14.030690 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5ebaef65-ea76-4ac1-bdd7-15001868e551 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:14.037896 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ebaef65-ea76-4ac1-bdd7-15001868e551 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:14.038385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ebaef65-ea76-4ac1-bdd7-15001868e551 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:14.038801 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ebaef65-ea76-4ac1-bdd7-15001868e551 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:14.039493 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ebaef65-ea76-4ac1-bdd7-15001868e551 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:14.040043 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ebaef65-ea76-4ac1-bdd7-15001868e551 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:14.040467 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ebaef65-ea76-4ac1-bdd7-15001868e551 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:14.103738 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5ebaef65-ea76-4ac1-bdd7-15001868e551 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:14.112233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5ebaef65-ea76-4ac1-bdd7-15001868e551 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:14.113681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5ebaef65-ea76-4ac1-bdd7-15001868e551 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:14.114808 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5ebaef65-ea76-4ac1-bdd7-15001868e551 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1330 microversion: 2.20 time: 0.089306 Sep 15 19:36:14.115359 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 728/997] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:14 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1330 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:36:15.141150 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2f07a84c-6108-44b0-b1ef-c2d2c979bb16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:15.141847 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2f07a84c-6108-44b0-b1ef-c2d2c979bb16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:15.149893 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f07a84c-6108-44b0-b1ef-c2d2c979bb16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:15.150294 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f07a84c-6108-44b0-b1ef-c2d2c979bb16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:15.150799 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f07a84c-6108-44b0-b1ef-c2d2c979bb16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:15.151506 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f07a84c-6108-44b0-b1ef-c2d2c979bb16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:15.151984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f07a84c-6108-44b0-b1ef-c2d2c979bb16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:15.152616 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f07a84c-6108-44b0-b1ef-c2d2c979bb16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:15.224055 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2f07a84c-6108-44b0-b1ef-c2d2c979bb16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:15.234321 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2f07a84c-6108-44b0-b1ef-c2d2c979bb16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:15.240606 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2f07a84c-6108-44b0-b1ef-c2d2c979bb16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:15.240606 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2f07a84c-6108-44b0-b1ef-c2d2c979bb16 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1336 microversion: 2.20 time: 0.100455 Sep 15 19:36:15.240606 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 729/998] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:15 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:16.264684 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-931f15c7-6de1-4ed2-8781-b9aaf299b188 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:16.265355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-931f15c7-6de1-4ed2-8781-b9aaf299b188 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:16.272165 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-931f15c7-6de1-4ed2-8781-b9aaf299b188 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:16.272998 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-931f15c7-6de1-4ed2-8781-b9aaf299b188 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:16.273644 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-931f15c7-6de1-4ed2-8781-b9aaf299b188 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:16.274435 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-931f15c7-6de1-4ed2-8781-b9aaf299b188 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:16.275733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-931f15c7-6de1-4ed2-8781-b9aaf299b188 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:16.275901 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-931f15c7-6de1-4ed2-8781-b9aaf299b188 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:16.453947 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-931f15c7-6de1-4ed2-8781-b9aaf299b188 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:16.462712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-931f15c7-6de1-4ed2-8781-b9aaf299b188 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:16.464209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-931f15c7-6de1-4ed2-8781-b9aaf299b188 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:16.465391 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-931f15c7-6de1-4ed2-8781-b9aaf299b188 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1403 microversion: 2.20 time: 0.206400 Sep 15 19:36:16.466257 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 730/999] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:16 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1403 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:16.507573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-6601fae1-4cac-4128-8594-7135ddea01ec req-c7b5d340-7949-4767-aea5-3ef960471c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a46951e-b221-4405-8b11-ffa4fa53af9c", "tag": "1f316119-2ccf-4680-9480-faced50dd6b6"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:36:16.519102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-6601fae1-4cac-4128-8594-7135ddea01ec req-c7b5d340-7949-4767-aea5-3ef960471c9b service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:16.519567 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-6601fae1-4cac-4128-8594-7135ddea01ec req-c7b5d340-7949-4767-aea5-3ef960471c9b service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:16.520043 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-6601fae1-4cac-4128-8594-7135ddea01ec req-c7b5d340-7949-4767-aea5-3ef960471c9b service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:16.531558 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-6601fae1-4cac-4128-8594-7135ddea01ec req-c7b5d340-7949-4767-aea5-3ef960471c9b service nova] Creating event network-changed:1f316119-2ccf-4680-9480-faced50dd6b6 for instance 0a46951e-b221-4405-8b11-ffa4fa53af9c on hv-cinder-84984 Sep 15 19:36:16.537047 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-6601fae1-4cac-4128-8594-7135ddea01ec req-c7b5d340-7949-4767-aea5-3ef960471c9b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033836 Sep 15 19:36:16.537657 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 731/1000] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:36:17.491541 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-45435e65-d4b9-4ec0-95cb-1afa53ebcf9e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:17.492247 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-45435e65-d4b9-4ec0-95cb-1afa53ebcf9e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:17.499140 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45435e65-d4b9-4ec0-95cb-1afa53ebcf9e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:17.499615 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45435e65-d4b9-4ec0-95cb-1afa53ebcf9e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:17.500069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45435e65-d4b9-4ec0-95cb-1afa53ebcf9e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:17.500760 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45435e65-d4b9-4ec0-95cb-1afa53ebcf9e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:17.501205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45435e65-d4b9-4ec0-95cb-1afa53ebcf9e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:17.501629 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45435e65-d4b9-4ec0-95cb-1afa53ebcf9e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:17.643200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-45435e65-d4b9-4ec0-95cb-1afa53ebcf9e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:17.652101 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-45435e65-d4b9-4ec0-95cb-1afa53ebcf9e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:17.653569 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-45435e65-d4b9-4ec0-95cb-1afa53ebcf9e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:17.654690 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-45435e65-d4b9-4ec0-95cb-1afa53ebcf9e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1403 microversion: 2.20 time: 0.168065 Sep 15 19:36:17.655256 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 732/1001] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:17 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1403 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:18.679417 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3b49d9ac-da05-46fa-9c08-42991169c115 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:18.680146 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3b49d9ac-da05-46fa-9c08-42991169c115 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:18.686666 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b49d9ac-da05-46fa-9c08-42991169c115 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:18.687139 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b49d9ac-da05-46fa-9c08-42991169c115 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:18.687571 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b49d9ac-da05-46fa-9c08-42991169c115 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:18.688280 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b49d9ac-da05-46fa-9c08-42991169c115 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:18.688728 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b49d9ac-da05-46fa-9c08-42991169c115 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:18.689146 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b49d9ac-da05-46fa-9c08-42991169c115 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:18.820811 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3b49d9ac-da05-46fa-9c08-42991169c115 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:18.828901 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3b49d9ac-da05-46fa-9c08-42991169c115 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:18.830365 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3b49d9ac-da05-46fa-9c08-42991169c115 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:18.831485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3b49d9ac-da05-46fa-9c08-42991169c115 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1403 microversion: 2.20 time: 0.156098 Sep 15 19:36:18.832077 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 733/1002] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:18 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1403 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:19.857495 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-506002c7-a9b9-404d-988b-ec7d908640fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:19.858196 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-506002c7-a9b9-404d-988b-ec7d908640fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:19.860239 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:36:19.860980 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=12 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:36:19.867429 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-506002c7-a9b9-404d-988b-ec7d908640fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:19.867930 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-506002c7-a9b9-404d-988b-ec7d908640fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:19.869050 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-506002c7-a9b9-404d-988b-ec7d908640fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:19.869750 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-506002c7-a9b9-404d-988b-ec7d908640fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:19.870203 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-506002c7-a9b9-404d-988b-ec7d908640fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:19.870620 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-506002c7-a9b9-404d-988b-ec7d908640fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:20.029754 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-506002c7-a9b9-404d-988b-ec7d908640fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:20.037949 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-506002c7-a9b9-404d-988b-ec7d908640fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:20.039388 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-506002c7-a9b9-404d-988b-ec7d908640fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:20.041134 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-506002c7-a9b9-404d-988b-ec7d908640fa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1403 microversion: 2.20 time: 0.187771 Sep 15 19:36:20.041704 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 734/1003] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:19 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1403 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:21.072053 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-12a6b472-2ae4-4b71-918e-d66305ba7b7f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:21.072677 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-12a6b472-2ae4-4b71-918e-d66305ba7b7f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:21.079362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12a6b472-2ae4-4b71-918e-d66305ba7b7f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:21.079874 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12a6b472-2ae4-4b71-918e-d66305ba7b7f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:21.080313 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12a6b472-2ae4-4b71-918e-d66305ba7b7f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:21.081701 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12a6b472-2ae4-4b71-918e-d66305ba7b7f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:21.082176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12a6b472-2ae4-4b71-918e-d66305ba7b7f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:21.082616 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-12a6b472-2ae4-4b71-918e-d66305ba7b7f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:21.224106 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-12a6b472-2ae4-4b71-918e-d66305ba7b7f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:21.234610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-12a6b472-2ae4-4b71-918e-d66305ba7b7f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:21.236179 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-12a6b472-2ae4-4b71-918e-d66305ba7b7f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:21.237289 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-12a6b472-2ae4-4b71-918e-d66305ba7b7f tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1403 microversion: 2.20 time: 0.169922 Sep 15 19:36:21.237884 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 735/1004] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:21 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1403 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:22.249059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-df5faa8d-a713-4148-91af-6a7b61d0da43 req-85294cde-1f3b-4387-a0ee-3bccd7ee764c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a46951e-b221-4405-8b11-ffa4fa53af9c", "name": "network-vif-plugged", "status": "completed", "tag": "1f316119-2ccf-4680-9480-faced50dd6b6"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:36:22.260159 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-df5faa8d-a713-4148-91af-6a7b61d0da43 req-85294cde-1f3b-4387-a0ee-3bccd7ee764c service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:22.260638 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-df5faa8d-a713-4148-91af-6a7b61d0da43 req-85294cde-1f3b-4387-a0ee-3bccd7ee764c service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:22.261213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-df5faa8d-a713-4148-91af-6a7b61d0da43 req-85294cde-1f3b-4387-a0ee-3bccd7ee764c service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:22.272480 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-df5faa8d-a713-4148-91af-6a7b61d0da43 req-85294cde-1f3b-4387-a0ee-3bccd7ee764c service nova] Creating event network-vif-plugged:1f316119-2ccf-4680-9480-faced50dd6b6 for instance 0a46951e-b221-4405-8b11-ffa4fa53af9c on hv-cinder-84984 Sep 15 19:36:22.277704 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-df5faa8d-a713-4148-91af-6a7b61d0da43 req-85294cde-1f3b-4387-a0ee-3bccd7ee764c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033854 Sep 15 19:36:22.278344 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 736/1005] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:36:22.284654 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0fbf1f0f-2427-42fa-921f-f582e220c61c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:22.285421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0fbf1f0f-2427-42fa-921f-f582e220c61c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:22.292597 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fbf1f0f-2427-42fa-921f-f582e220c61c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:22.293183 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fbf1f0f-2427-42fa-921f-f582e220c61c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:22.293661 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fbf1f0f-2427-42fa-921f-f582e220c61c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:22.294304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fbf1f0f-2427-42fa-921f-f582e220c61c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:22.294754 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fbf1f0f-2427-42fa-921f-f582e220c61c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:22.295179 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fbf1f0f-2427-42fa-921f-f582e220c61c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:22.448976 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0fbf1f0f-2427-42fa-921f-f582e220c61c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:22.457496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0fbf1f0f-2427-42fa-921f-f582e220c61c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:22.458945 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0fbf1f0f-2427-42fa-921f-f582e220c61c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:22.460078 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0fbf1f0f-2427-42fa-921f-f582e220c61c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1403 microversion: 2.20 time: 0.180370 Sep 15 19:36:22.460641 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 737/1006] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:22 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1403 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:36:23.486029 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e8bc068d-6b68-473f-b9ff-d1963402972a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:23.486712 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e8bc068d-6b68-473f-b9ff-d1963402972a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:23.493185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8bc068d-6b68-473f-b9ff-d1963402972a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:23.493664 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8bc068d-6b68-473f-b9ff-d1963402972a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:23.494133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8bc068d-6b68-473f-b9ff-d1963402972a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:23.495385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8bc068d-6b68-473f-b9ff-d1963402972a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:23.495869 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8bc068d-6b68-473f-b9ff-d1963402972a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:23.496296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e8bc068d-6b68-473f-b9ff-d1963402972a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:23.630739 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e8bc068d-6b68-473f-b9ff-d1963402972a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:23.639513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e8bc068d-6b68-473f-b9ff-d1963402972a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:23.641031 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e8bc068d-6b68-473f-b9ff-d1963402972a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:23.642132 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e8bc068d-6b68-473f-b9ff-d1963402972a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1403 microversion: 2.20 time: 0.160126 Sep 15 19:36:23.642728 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 738/1007] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:23 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1403 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:36:24.669434 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f397d7a5-160b-4e74-a252-411240b1bfe3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:24.670281 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f397d7a5-160b-4e74-a252-411240b1bfe3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:24.676610 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f397d7a5-160b-4e74-a252-411240b1bfe3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:24.677091 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f397d7a5-160b-4e74-a252-411240b1bfe3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:24.677552 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f397d7a5-160b-4e74-a252-411240b1bfe3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:24.678251 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f397d7a5-160b-4e74-a252-411240b1bfe3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:24.678699 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f397d7a5-160b-4e74-a252-411240b1bfe3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:24.679123 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f397d7a5-160b-4e74-a252-411240b1bfe3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:24.821937 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f397d7a5-160b-4e74-a252-411240b1bfe3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:24.831366 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f397d7a5-160b-4e74-a252-411240b1bfe3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:24.832915 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f397d7a5-160b-4e74-a252-411240b1bfe3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:36:24.834121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f397d7a5-160b-4e74-a252-411240b1bfe3 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1595 microversion: 2.20 time: 0.168733 Sep 15 19:36:24.834711 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 739/1008] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:36:24 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1595 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:36:24.858618 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fe7a1554-538d-4442-942c-e1fa3fb97469 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:36:24.859104 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fe7a1554-538d-4442-942c-e1fa3fb97469 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:36:24.865098 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe7a1554-538d-4442-942c-e1fa3fb97469 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:24.865569 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe7a1554-538d-4442-942c-e1fa3fb97469 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:24.866001 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe7a1554-538d-4442-942c-e1fa3fb97469 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:24.866686 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe7a1554-538d-4442-942c-e1fa3fb97469 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:24.867127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe7a1554-538d-4442-942c-e1fa3fb97469 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:24.867546 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe7a1554-538d-4442-942c-e1fa3fb97469 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:24.954042 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fe7a1554-538d-4442-942c-e1fa3fb97469 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.099321 Sep 15 19:36:24.954672 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 740/1009] 10.222.0.18 () {60 vars in 1316 bytes} [Thu Sep 15 19:36:24 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 19:36:26.271480 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-aadb9730-4117-4f17-8dab-24b79261102a req-d10dd295-8783-4edf-a102-f0bf1c8a9477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a46951e-b221-4405-8b11-ffa4fa53af9c", "tag": "1f316119-2ccf-4680-9480-faced50dd6b6"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:36:26.281938 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-aadb9730-4117-4f17-8dab-24b79261102a req-d10dd295-8783-4edf-a102-f0bf1c8a9477 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:36:26.282412 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-aadb9730-4117-4f17-8dab-24b79261102a req-d10dd295-8783-4edf-a102-f0bf1c8a9477 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:36:26.283014 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-aadb9730-4117-4f17-8dab-24b79261102a req-d10dd295-8783-4edf-a102-f0bf1c8a9477 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:36:26.295094 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-aadb9730-4117-4f17-8dab-24b79261102a req-d10dd295-8783-4edf-a102-f0bf1c8a9477 service nova] Creating event network-changed:1f316119-2ccf-4680-9480-faced50dd6b6 for instance 0a46951e-b221-4405-8b11-ffa4fa53af9c on hv-cinder-84984 Sep 15 19:36:26.306538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-aadb9730-4117-4f17-8dab-24b79261102a req-d10dd295-8783-4edf-a102-f0bf1c8a9477 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033818 Sep 15 19:36:26.306538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 741/1010] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:36:39.794401 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 19:36:39.795024 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Thu Sep 15 19:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Sep 15 19:37:00.616230 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 19:37:00.616993 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Thu Sep 15 19:37:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Sep 15 19:37:02.568026 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=29 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:37:02.568792 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=70 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:37:02.573168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-93c85594-1bb7-4c8b-9f22-73b11c87220a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:02.573816 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-93c85594-1bb7-4c8b-9f22-73b11c87220a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:02.580266 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93c85594-1bb7-4c8b-9f22-73b11c87220a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:02.580749 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93c85594-1bb7-4c8b-9f22-73b11c87220a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:02.581194 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93c85594-1bb7-4c8b-9f22-73b11c87220a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:02.581904 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93c85594-1bb7-4c8b-9f22-73b11c87220a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:02.582354 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93c85594-1bb7-4c8b-9f22-73b11c87220a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:02.582806 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93c85594-1bb7-4c8b-9f22-73b11c87220a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:02.608201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-93c85594-1bb7-4c8b-9f22-73b11c87220a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/ips" status: 200 len: 151 microversion: 2.20 time: 0.041635 Sep 15 19:37:02.608792 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 742/1011] 10.222.0.18 () {60 vars in 1289 bytes} [Thu Sep 15 19:37:02 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 19:37:03.488340 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9bfcd12a-1b04-4c42-93ea-cb249d812bea tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:03.490616 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9bfcd12a-1b04-4c42-93ea-cb249d812bea tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:03.502131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9bfcd12a-1b04-4c42-93ea-cb249d812bea tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:03.502727 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9bfcd12a-1b04-4c42-93ea-cb249d812bea tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:03.503241 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9bfcd12a-1b04-4c42-93ea-cb249d812bea tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:03.504130 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9bfcd12a-1b04-4c42-93ea-cb249d812bea tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:03.504672 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9bfcd12a-1b04-4c42-93ea-cb249d812bea tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:03.505190 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9bfcd12a-1b04-4c42-93ea-cb249d812bea tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:03.535058 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9bfcd12a-1b04-4c42-93ea-cb249d812bea tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:37:04.113288 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 19:37:04.113981 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Thu Sep 15 19:37:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Sep 15 19:37:04.710487 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9bfcd12a-1b04-4c42-93ea-cb249d812bea tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 204 len: 0 microversion: 2.1 time: 1.226499 Sep 15 19:37:04.711190 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 743/1012] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 15 19:37:03 2022] DELETE /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 0 bytes in 1229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 19:37:04.716559 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-8f267bd6-e5c9-494e-90d2-5c97d013cb45 req-c6eddc82-c8a4-4f3b-977e-06b98b4c2ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb1a7eec-51a4-496a-a361-cb2e7f0b6f65", "tag": "5d9355ed-482e-4597-88f4-9572e304ef13"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:37:04.727600 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-8f267bd6-e5c9-494e-90d2-5c97d013cb45 req-c6eddc82-c8a4-4f3b-977e-06b98b4c2ef9 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:04.728101 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-8f267bd6-e5c9-494e-90d2-5c97d013cb45 req-c6eddc82-c8a4-4f3b-977e-06b98b4c2ef9 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:04.728535 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-8f267bd6-e5c9-494e-90d2-5c97d013cb45 req-c6eddc82-c8a4-4f3b-977e-06b98b4c2ef9 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:04.739451 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-8f267bd6-e5c9-494e-90d2-5c97d013cb45 req-c6eddc82-c8a4-4f3b-977e-06b98b4c2ef9 service nova] Creating event network-changed:5d9355ed-482e-4597-88f4-9572e304ef13 for instance eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 on hv-cinder-84984 Sep 15 19:37:04.744796 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-8f267bd6-e5c9-494e-90d2-5c97d013cb45 req-c6eddc82-c8a4-4f3b-977e-06b98b4c2ef9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032138 Sep 15 19:37:04.745423 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 744/1013] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 19:37:04.750538 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-03cc0dc8-d8dd-4364-8eb1-c415e7077ac0 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:04.751217 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-03cc0dc8-d8dd-4364-8eb1-c415e7077ac0 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:04.758077 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03cc0dc8-d8dd-4364-8eb1-c415e7077ac0 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:04.758554 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03cc0dc8-d8dd-4364-8eb1-c415e7077ac0 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:04.758985 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03cc0dc8-d8dd-4364-8eb1-c415e7077ac0 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:04.759711 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03cc0dc8-d8dd-4364-8eb1-c415e7077ac0 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:04.760159 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03cc0dc8-d8dd-4364-8eb1-c415e7077ac0 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:04.760576 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03cc0dc8-d8dd-4364-8eb1-c415e7077ac0 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:05.076390 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-03cc0dc8-d8dd-4364-8eb1-c415e7077ac0 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:05.084240 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-03cc0dc8-d8dd-4364-8eb1-c415e7077ac0 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.337707 Sep 15 19:37:05.084940 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 745/1014] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:37:04 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:37:05.751224 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4f141c17-dc23-46ff-a841-52bc7abc007e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:37:05.752017 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4f141c17-dc23-46ff-a841-52bc7abc007e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:05.758478 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4f141c17-dc23-46ff-a841-52bc7abc007e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:05.758967 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4f141c17-dc23-46ff-a841-52bc7abc007e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:05.759407 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4f141c17-dc23-46ff-a841-52bc7abc007e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:05.760139 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4f141c17-dc23-46ff-a841-52bc7abc007e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:05.760591 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4f141c17-dc23-46ff-a841-52bc7abc007e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:05.761021 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4f141c17-dc23-46ff-a841-52bc7abc007e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:05.785374 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-4f141c17-dc23-46ff-a841-52bc7abc007e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lazy-loading 'flavor' on Instance uuid 0a46951e-b221-4405-8b11-ffa4fa53af9c {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 19:37:06.421213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4f141c17-dc23-46ff-a841-52bc7abc007e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "POST /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/action" status: 202 len: 0 microversion: 2.20 time: 0.674021 Sep 15 19:37:06.421920 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 746/1015] 10.222.0.18 () {62 vars in 1319 bytes} [Thu Sep 15 19:37:05 2022] POST /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/action => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 19:37:06.427430 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1b6eb21a-7996-4a4d-938b-1a3e6dcb7c34 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:06.430858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1b6eb21a-7996-4a4d-938b-1a3e6dcb7c34 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:06.435357 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b6eb21a-7996-4a4d-938b-1a3e6dcb7c34 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:06.436530 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b6eb21a-7996-4a4d-938b-1a3e6dcb7c34 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:06.436881 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b6eb21a-7996-4a4d-938b-1a3e6dcb7c34 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:06.437594 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b6eb21a-7996-4a4d-938b-1a3e6dcb7c34 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:06.438049 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b6eb21a-7996-4a4d-938b-1a3e6dcb7c34 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:06.438472 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b6eb21a-7996-4a4d-938b-1a3e6dcb7c34 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:06.756408 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1b6eb21a-7996-4a4d-938b-1a3e6dcb7c34 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:06.765848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1b6eb21a-7996-4a4d-938b-1a3e6dcb7c34 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1567 microversion: 2.1 time: 0.342430 Sep 15 19:37:06.766580 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 747/1016] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:37:06 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1567 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 19:37:06.772132 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bd1c961f-ed76-41ce-b611-75b2b1380122 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:06.772823 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bd1c961f-ed76-41ce-b611-75b2b1380122 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:06.779003 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bd1c961f-ed76-41ce-b611-75b2b1380122 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:06.780259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bd1c961f-ed76-41ce-b611-75b2b1380122 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:06.780858 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bd1c961f-ed76-41ce-b611-75b2b1380122 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:06.782016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bd1c961f-ed76-41ce-b611-75b2b1380122 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:06.782767 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bd1c961f-ed76-41ce-b611-75b2b1380122 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:06.783196 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bd1c961f-ed76-41ce-b611-75b2b1380122 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:06.995828 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bd1c961f-ed76-41ce-b611-75b2b1380122 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:07.004835 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bd1c961f-ed76-41ce-b611-75b2b1380122 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:07.006328 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bd1c961f-ed76-41ce-b611-75b2b1380122 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:07.007547 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bd1c961f-ed76-41ce-b611-75b2b1380122 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1719 microversion: 2.20 time: 0.239888 Sep 15 19:37:07.008151 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 748/1017] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:06 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1719 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:37:07.194720 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-f9d3c445-ae8a-4e80-9c93-e26afc460ff3 req-90d4fbd7-cf02-464c-8da7-b50816b64a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1a7eec-51a4-496a-a361-cb2e7f0b6f65", "name": "network-vif-deleted", "tag": "5d9355ed-482e-4597-88f4-9572e304ef13"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:37:07.205211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-f9d3c445-ae8a-4e80-9c93-e26afc460ff3 req-90d4fbd7-cf02-464c-8da7-b50816b64a8c service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:07.206719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-f9d3c445-ae8a-4e80-9c93-e26afc460ff3 req-90d4fbd7-cf02-464c-8da7-b50816b64a8c service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:07.206719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-f9d3c445-ae8a-4e80-9c93-e26afc460ff3 req-90d4fbd7-cf02-464c-8da7-b50816b64a8c service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:07.218171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-f9d3c445-ae8a-4e80-9c93-e26afc460ff3 req-90d4fbd7-cf02-464c-8da7-b50816b64a8c service nova] Creating event network-vif-deleted:5d9355ed-482e-4597-88f4-9572e304ef13 for instance eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 on hv-cinder-84984 Sep 15 19:37:07.223122 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-f9d3c445-ae8a-4e80-9c93-e26afc460ff3 req-90d4fbd7-cf02-464c-8da7-b50816b64a8c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032432 Sep 15 19:37:07.223932 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 749/1018] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:37:07.790659 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-08d1c583-45ca-40f8-81c1-02bf31a7d5a6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:07.791350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-08d1c583-45ca-40f8-81c1-02bf31a7d5a6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:07.798206 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08d1c583-45ca-40f8-81c1-02bf31a7d5a6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:07.798680 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08d1c583-45ca-40f8-81c1-02bf31a7d5a6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:07.799115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08d1c583-45ca-40f8-81c1-02bf31a7d5a6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:07.799838 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08d1c583-45ca-40f8-81c1-02bf31a7d5a6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:07.800296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08d1c583-45ca-40f8-81c1-02bf31a7d5a6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:07.800719 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08d1c583-45ca-40f8-81c1-02bf31a7d5a6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:07.877369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-08d1c583-45ca-40f8-81c1-02bf31a7d5a6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638c6d935e64be6bce4ecc1fb8f26ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bbec449c0142f0b910956bacedbe5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:07.885251 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-08d1c583-45ca-40f8-81c1-02bf31a7d5a6 tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 200 len: 1218 microversion: 2.1 time: 0.098892 Sep 15 19:37:07.886044 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 750/1019] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:37:07 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:37:08.033732 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0b07a270-a496-4c8a-b556-3566abd7663c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:08.034350 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0b07a270-a496-4c8a-b556-3566abd7663c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:08.040401 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b07a270-a496-4c8a-b556-3566abd7663c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:08.040883 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b07a270-a496-4c8a-b556-3566abd7663c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:08.041315 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b07a270-a496-4c8a-b556-3566abd7663c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:08.042058 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b07a270-a496-4c8a-b556-3566abd7663c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:08.042530 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b07a270-a496-4c8a-b556-3566abd7663c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:08.042929 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b07a270-a496-4c8a-b556-3566abd7663c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:08.175031 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0b07a270-a496-4c8a-b556-3566abd7663c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:08.183208 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0b07a270-a496-4c8a-b556-3566abd7663c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:08.184792 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0b07a270-a496-4c8a-b556-3566abd7663c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:08.185854 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0b07a270-a496-4c8a-b556-3566abd7663c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1719 microversion: 2.20 time: 0.156384 Sep 15 19:37:08.187481 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 751/1020] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:08 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:09.020446 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5f34e8a9-2d1e-4a2a-b8a5-75965778c98f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:09.021155 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5f34e8a9-2d1e-4a2a-b8a5-75965778c98f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] [instance: eb1a7eec-51a4-496a-a361-cb2e7f0b6f65] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:09.027487 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5f34e8a9-2d1e-4a2a-b8a5-75965778c98f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:09.028018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5f34e8a9-2d1e-4a2a-b8a5-75965778c98f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:09.028446 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5f34e8a9-2d1e-4a2a-b8a5-75965778c98f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:09.029130 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5f34e8a9-2d1e-4a2a-b8a5-75965778c98f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:09.029573 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5f34e8a9-2d1e-4a2a-b8a5-75965778c98f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:09.029990 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5f34e8a9-2d1e-4a2a-b8a5-75965778c98f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:09.044513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-5f34e8a9-2d1e-4a2a-b8a5-75965778c98f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] HTTP exception thrown: Instance eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 could not be found. Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5f34e8a9-2d1e-4a2a-b8a5-75965778c98f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Request method failure captured: Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 HTTP/1.1 Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI32uAc_liwc5rBUdc1YC7ZNSJlsrAfpOy3rZUc51mZNvIV6S6RSSPm852Alfb5ky0bqkBrijKfmDzxG3K-bTvdZ3Oz9zWj0tNLrJ5OtgSeHt7mkUE9igHC9yEU-zb3ZLACf0NL_CgCILne8z-5LNIQ4zVMfc2B8b_YLebw-S7f-mloc Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: a7bbec449c0142f0b910956bacedbe5e Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-TestShelveInstance-2140133085 Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:37:09.046906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:37:09.051102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a7bbec449c0142f0b910956bacedbe5e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a7bbec449c0142f0b910956bacedbe5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a7bbec449c0142f0b910956bacedbe5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a7bbec449c0142f0b910956bacedbe5e"}]}] Sep 15 19:37:09.051102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-TestShelveInstance-2140133085 Sep 15 19:37:09.051102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: a7bbec449c0142f0b910956bacedbe5e Sep 15 19:37:09.051102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-TestShelveInstance-2140133085 Sep 15 19:37:09.051102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-TestShelveInstance-2140133085-project Sep 15 19:37:09.051102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:37:09.051102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:37:09.051102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: b638c6d935e64be6bce4ecc1fb8f26ec Sep 15 19:37:09.051102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-TestShelveInstance-2140133085-project Sep 15 19:37:09.051102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:37:09.051102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 could not be found. Sep 15 19:37:09.051102 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'eb1a7eec-51a4-496a-a361-cb2e7f0b6f65'} Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 could not be found. Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:37:09.052362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 could not be found. Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 could not be found. Sep 15 19:37:09.054028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:37:09.056047 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5f34e8a9-2d1e-4a2a-b8a5-75965778c98f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Returning 404 to user: Instance eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:37:09.056047 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5f34e8a9-2d1e-4a2a-b8a5-75965778c98f tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65" status: 404 len: 111 microversion: 2.1 time: 0.141233 Sep 15 19:37:09.056047 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 752/1021] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 15 19:37:08 2022] GET /compute/v2.1/servers/eb1a7eec-51a4-496a-a361-cb2e7f0b6f65 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 19:37:09.213653 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0cbc42c9-cbf4-443c-80f6-f68e6f8bfbfd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:09.214175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0cbc42c9-cbf4-443c-80f6-f68e6f8bfbfd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:09.222123 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0cbc42c9-cbf4-443c-80f6-f68e6f8bfbfd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:09.222585 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0cbc42c9-cbf4-443c-80f6-f68e6f8bfbfd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:09.223043 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0cbc42c9-cbf4-443c-80f6-f68e6f8bfbfd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:09.223843 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0cbc42c9-cbf4-443c-80f6-f68e6f8bfbfd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:09.224277 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0cbc42c9-cbf4-443c-80f6-f68e6f8bfbfd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:09.224704 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0cbc42c9-cbf4-443c-80f6-f68e6f8bfbfd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:09.360814 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0cbc42c9-cbf4-443c-80f6-f68e6f8bfbfd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:09.369240 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0cbc42c9-cbf4-443c-80f6-f68e6f8bfbfd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:09.370746 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0cbc42c9-cbf4-443c-80f6-f68e6f8bfbfd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:09.371957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0cbc42c9-cbf4-443c-80f6-f68e6f8bfbfd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1719 microversion: 2.20 time: 0.162400 Sep 15 19:37:09.372520 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 753/1022] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:09 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:09.377235 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9e9f4113-148b-451c-a515-b23ed4218bcb tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] Calling method '.version_select at 0x7f55203cb550>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:09.473900 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9e9f4113-148b-451c-a515-b23ed4218bcb tempest-TestShelveInstance-2140133085 tempest-TestShelveInstance-2140133085-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-263373816" status: 202 len: 0 microversion: 2.1 time: 0.100132 Sep 15 19:37:09.474409 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 754/1023] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 15 19:37:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-263373816 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 19:37:10.398414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0bbf3727-6105-4ce5-a087-1e0ff9aab289 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:10.399153 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0bbf3727-6105-4ce5-a087-1e0ff9aab289 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:10.406209 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0bbf3727-6105-4ce5-a087-1e0ff9aab289 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:10.406693 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0bbf3727-6105-4ce5-a087-1e0ff9aab289 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:10.407129 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0bbf3727-6105-4ce5-a087-1e0ff9aab289 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:10.407866 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0bbf3727-6105-4ce5-a087-1e0ff9aab289 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:10.408316 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0bbf3727-6105-4ce5-a087-1e0ff9aab289 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:10.408735 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0bbf3727-6105-4ce5-a087-1e0ff9aab289 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:10.881999 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0bbf3727-6105-4ce5-a087-1e0ff9aab289 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:10.893433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0bbf3727-6105-4ce5-a087-1e0ff9aab289 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:10.894909 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0bbf3727-6105-4ce5-a087-1e0ff9aab289 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:10.896171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0bbf3727-6105-4ce5-a087-1e0ff9aab289 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1719 microversion: 2.20 time: 0.502191 Sep 15 19:37:10.896743 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 755/1024] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:10 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1719 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:11.924853 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-72e2e434-ef67-4e4b-b740-96bfdaf9922e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:11.925666 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-72e2e434-ef67-4e4b-b740-96bfdaf9922e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:11.932794 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-72e2e434-ef67-4e4b-b740-96bfdaf9922e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:11.939823 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-72e2e434-ef67-4e4b-b740-96bfdaf9922e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:11.939823 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-72e2e434-ef67-4e4b-b740-96bfdaf9922e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:11.939823 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-72e2e434-ef67-4e4b-b740-96bfdaf9922e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:11.939823 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-72e2e434-ef67-4e4b-b740-96bfdaf9922e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:11.940570 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-72e2e434-ef67-4e4b-b740-96bfdaf9922e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:12.130369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-72e2e434-ef67-4e4b-b740-96bfdaf9922e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:12.144349 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-72e2e434-ef67-4e4b-b740-96bfdaf9922e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:12.144349 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-72e2e434-ef67-4e4b-b740-96bfdaf9922e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:12.144349 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-72e2e434-ef67-4e4b-b740-96bfdaf9922e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1719 microversion: 2.20 time: 0.223334 Sep 15 19:37:12.144779 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 756/1025] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:11 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:13.168299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9e2b38ea-f25d-4ae9-8751-e9c52d8d4579 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:13.169196 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9e2b38ea-f25d-4ae9-8751-e9c52d8d4579 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:13.180355 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e2b38ea-f25d-4ae9-8751-e9c52d8d4579 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:13.180855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e2b38ea-f25d-4ae9-8751-e9c52d8d4579 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:13.181647 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e2b38ea-f25d-4ae9-8751-e9c52d8d4579 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:13.182378 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e2b38ea-f25d-4ae9-8751-e9c52d8d4579 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:13.183018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e2b38ea-f25d-4ae9-8751-e9c52d8d4579 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:13.183611 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e2b38ea-f25d-4ae9-8751-e9c52d8d4579 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:13.425756 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9e2b38ea-f25d-4ae9-8751-e9c52d8d4579 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:13.435741 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9e2b38ea-f25d-4ae9-8751-e9c52d8d4579 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:13.437933 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9e2b38ea-f25d-4ae9-8751-e9c52d8d4579 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:13.439325 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9e2b38ea-f25d-4ae9-8751-e9c52d8d4579 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1719 microversion: 2.20 time: 0.275152 Sep 15 19:37:13.440044 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 757/1026] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:13 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1719 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:37:14.466132 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-caa30ec3-5f1a-41f3-83d1-8eb91633008e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:14.466769 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-caa30ec3-5f1a-41f3-83d1-8eb91633008e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:14.473850 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-caa30ec3-5f1a-41f3-83d1-8eb91633008e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:14.474333 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-caa30ec3-5f1a-41f3-83d1-8eb91633008e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:14.474764 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-caa30ec3-5f1a-41f3-83d1-8eb91633008e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:14.475501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-caa30ec3-5f1a-41f3-83d1-8eb91633008e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:14.475976 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-caa30ec3-5f1a-41f3-83d1-8eb91633008e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:14.476402 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-caa30ec3-5f1a-41f3-83d1-8eb91633008e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:14.480519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:37:14.617432 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-caa30ec3-5f1a-41f3-83d1-8eb91633008e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:14.626376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-caa30ec3-5f1a-41f3-83d1-8eb91633008e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:14.627862 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-caa30ec3-5f1a-41f3-83d1-8eb91633008e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:14.629469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-caa30ec3-5f1a-41f3-83d1-8eb91633008e tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1719 microversion: 2.20 time: 0.167729 Sep 15 19:37:14.630647 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 758/1027] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:14 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:15.655817 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ef7c3b0a-a8a2-43da-b133-679a1e2bf0b5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:15.656467 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ef7c3b0a-a8a2-43da-b133-679a1e2bf0b5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:15.662973 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef7c3b0a-a8a2-43da-b133-679a1e2bf0b5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:15.663444 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef7c3b0a-a8a2-43da-b133-679a1e2bf0b5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:15.663908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef7c3b0a-a8a2-43da-b133-679a1e2bf0b5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:15.664589 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef7c3b0a-a8a2-43da-b133-679a1e2bf0b5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:15.665040 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef7c3b0a-a8a2-43da-b133-679a1e2bf0b5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:15.665457 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef7c3b0a-a8a2-43da-b133-679a1e2bf0b5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:15.932047 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ef7c3b0a-a8a2-43da-b133-679a1e2bf0b5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:15.941486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ef7c3b0a-a8a2-43da-b133-679a1e2bf0b5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:15.942948 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ef7c3b0a-a8a2-43da-b133-679a1e2bf0b5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:15.944165 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ef7c3b0a-a8a2-43da-b133-679a1e2bf0b5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1719 microversion: 2.20 time: 0.292738 Sep 15 19:37:15.944717 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 759/1028] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:15 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1719 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:16.969944 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-99c4460c-04be-4caf-9cc0-03a910323c22 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:16.970537 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-99c4460c-04be-4caf-9cc0-03a910323c22 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:16.977219 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99c4460c-04be-4caf-9cc0-03a910323c22 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:16.977695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99c4460c-04be-4caf-9cc0-03a910323c22 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:16.978131 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99c4460c-04be-4caf-9cc0-03a910323c22 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:16.978823 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99c4460c-04be-4caf-9cc0-03a910323c22 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:16.979272 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99c4460c-04be-4caf-9cc0-03a910323c22 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:16.979804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99c4460c-04be-4caf-9cc0-03a910323c22 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:17.135551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-99c4460c-04be-4caf-9cc0-03a910323c22 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:17.144474 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-99c4460c-04be-4caf-9cc0-03a910323c22 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:17.145971 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-99c4460c-04be-4caf-9cc0-03a910323c22 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:17.147148 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-99c4460c-04be-4caf-9cc0-03a910323c22 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1719 microversion: 2.20 time: 0.182002 Sep 15 19:37:17.147734 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 760/1029] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:16 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1719 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:18.174724 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-52e4e579-baa1-48b9-bcb8-bf915d110ca5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:18.179788 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-52e4e579-baa1-48b9-bcb8-bf915d110ca5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:18.182057 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52e4e579-baa1-48b9-bcb8-bf915d110ca5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:18.182545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52e4e579-baa1-48b9-bcb8-bf915d110ca5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:18.183016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52e4e579-baa1-48b9-bcb8-bf915d110ca5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:18.183745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52e4e579-baa1-48b9-bcb8-bf915d110ca5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:18.184246 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52e4e579-baa1-48b9-bcb8-bf915d110ca5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:18.184671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52e4e579-baa1-48b9-bcb8-bf915d110ca5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:18.328291 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-52e4e579-baa1-48b9-bcb8-bf915d110ca5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:18.336686 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-52e4e579-baa1-48b9-bcb8-bf915d110ca5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:18.338273 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-52e4e579-baa1-48b9-bcb8-bf915d110ca5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:18.339393 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-52e4e579-baa1-48b9-bcb8-bf915d110ca5 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1740 microversion: 2.20 time: 0.168718 Sep 15 19:37:18.340069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 761/1030] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:18 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:19.368334 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cd8d459f-2f1d-42b0-8b1b-450c14794027 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:19.369018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cd8d459f-2f1d-42b0-8b1b-450c14794027 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:19.376200 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd8d459f-2f1d-42b0-8b1b-450c14794027 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:19.376681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd8d459f-2f1d-42b0-8b1b-450c14794027 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:19.377125 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd8d459f-2f1d-42b0-8b1b-450c14794027 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:19.377830 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd8d459f-2f1d-42b0-8b1b-450c14794027 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:19.378408 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd8d459f-2f1d-42b0-8b1b-450c14794027 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:19.378838 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd8d459f-2f1d-42b0-8b1b-450c14794027 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:19.527975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cd8d459f-2f1d-42b0-8b1b-450c14794027 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:19.536467 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cd8d459f-2f1d-42b0-8b1b-450c14794027 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:19.538034 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cd8d459f-2f1d-42b0-8b1b-450c14794027 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:19.539262 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cd8d459f-2f1d-42b0-8b1b-450c14794027 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1735 microversion: 2.20 time: 0.174954 Sep 15 19:37:19.539909 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 762/1031] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:19 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:20.354040 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-4bb0182b-7431-4f2d-a319-13797b33cfb1 req-e34520a8-9ee1-4911-8fa1-51d5f6790340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a46951e-b221-4405-8b11-ffa4fa53af9c", "name": "network-vif-plugged", "status": "completed", "tag": "1f316119-2ccf-4680-9480-faced50dd6b6"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:37:20.364753 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4bb0182b-7431-4f2d-a319-13797b33cfb1 req-e34520a8-9ee1-4911-8fa1-51d5f6790340 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:20.367073 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4bb0182b-7431-4f2d-a319-13797b33cfb1 req-e34520a8-9ee1-4911-8fa1-51d5f6790340 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:20.367073 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4bb0182b-7431-4f2d-a319-13797b33cfb1 req-e34520a8-9ee1-4911-8fa1-51d5f6790340 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:20.378394 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-4bb0182b-7431-4f2d-a319-13797b33cfb1 req-e34520a8-9ee1-4911-8fa1-51d5f6790340 service nova] Creating event network-vif-plugged:1f316119-2ccf-4680-9480-faced50dd6b6 for instance 0a46951e-b221-4405-8b11-ffa4fa53af9c on hv-cinder-84984 Sep 15 19:37:20.384372 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-4bb0182b-7431-4f2d-a319-13797b33cfb1 req-e34520a8-9ee1-4911-8fa1-51d5f6790340 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033080 Sep 15 19:37:20.385563 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 763/1032] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:37:20.576265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c79721b2-2466-43d3-8ed8-fe9a72e81e51 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:20.577425 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c79721b2-2466-43d3-8ed8-fe9a72e81e51 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:20.584201 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c79721b2-2466-43d3-8ed8-fe9a72e81e51 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:20.584987 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c79721b2-2466-43d3-8ed8-fe9a72e81e51 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:20.585601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c79721b2-2466-43d3-8ed8-fe9a72e81e51 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:20.586376 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c79721b2-2466-43d3-8ed8-fe9a72e81e51 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:20.586826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c79721b2-2466-43d3-8ed8-fe9a72e81e51 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:20.587431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c79721b2-2466-43d3-8ed8-fe9a72e81e51 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:20.752233 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c79721b2-2466-43d3-8ed8-fe9a72e81e51 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:20.761060 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c79721b2-2466-43d3-8ed8-fe9a72e81e51 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:20.762553 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c79721b2-2466-43d3-8ed8-fe9a72e81e51 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:20.764417 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c79721b2-2466-43d3-8ed8-fe9a72e81e51 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1735 microversion: 2.20 time: 0.196223 Sep 15 19:37:20.765485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 764/1033] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:20 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:37:21.790744 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a22af87c-9465-477a-af05-2540496044d7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:21.791696 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a22af87c-9465-477a-af05-2540496044d7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:21.800475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a22af87c-9465-477a-af05-2540496044d7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:21.801047 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a22af87c-9465-477a-af05-2540496044d7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:21.801513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a22af87c-9465-477a-af05-2540496044d7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:21.802212 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a22af87c-9465-477a-af05-2540496044d7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:21.802661 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a22af87c-9465-477a-af05-2540496044d7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:21.803079 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a22af87c-9465-477a-af05-2540496044d7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:21.957562 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a22af87c-9465-477a-af05-2540496044d7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:21.966786 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a22af87c-9465-477a-af05-2540496044d7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:21.968485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a22af87c-9465-477a-af05-2540496044d7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:21.969943 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a22af87c-9465-477a-af05-2540496044d7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1735 microversion: 2.20 time: 0.183354 Sep 15 19:37:21.970502 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 765/1034] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:21 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:22.996213 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1944e093-1c9b-4a4b-b06f-34305c045e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:22.996886 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1944e093-1c9b-4a4b-b06f-34305c045e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:23.004377 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1944e093-1c9b-4a4b-b06f-34305c045e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:23.005133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1944e093-1c9b-4a4b-b06f-34305c045e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:23.005808 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1944e093-1c9b-4a4b-b06f-34305c045e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:23.006749 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1944e093-1c9b-4a4b-b06f-34305c045e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:23.007421 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1944e093-1c9b-4a4b-b06f-34305c045e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:23.007880 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1944e093-1c9b-4a4b-b06f-34305c045e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:23.179699 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1944e093-1c9b-4a4b-b06f-34305c045e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:23.190974 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1944e093-1c9b-4a4b-b06f-34305c045e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:23.192832 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1944e093-1c9b-4a4b-b06f-34305c045e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:23.194278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1944e093-1c9b-4a4b-b06f-34305c045e19 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1735 microversion: 2.20 time: 0.202087 Sep 15 19:37:23.195051 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 766/1035] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:22 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:37:24.221496 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6fa5693f-8245-4e09-b228-e1b16935e7eb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:24.223298 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6fa5693f-8245-4e09-b228-e1b16935e7eb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:24.233433 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6fa5693f-8245-4e09-b228-e1b16935e7eb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:24.234603 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6fa5693f-8245-4e09-b228-e1b16935e7eb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:24.235380 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6fa5693f-8245-4e09-b228-e1b16935e7eb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:24.236900 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6fa5693f-8245-4e09-b228-e1b16935e7eb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:24.237582 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6fa5693f-8245-4e09-b228-e1b16935e7eb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:24.238340 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6fa5693f-8245-4e09-b228-e1b16935e7eb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:24.403756 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6fa5693f-8245-4e09-b228-e1b16935e7eb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:24.413682 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6fa5693f-8245-4e09-b228-e1b16935e7eb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:24.415297 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6fa5693f-8245-4e09-b228-e1b16935e7eb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:24.416523 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6fa5693f-8245-4e09-b228-e1b16935e7eb tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1735 microversion: 2.20 time: 0.199711 Sep 15 19:37:24.417285 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 767/1036] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:24 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:25.443529 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-89cca520-f59e-41a1-99e6-0d42eee1a18a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:25.444323 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-89cca520-f59e-41a1-99e6-0d42eee1a18a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:25.450928 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89cca520-f59e-41a1-99e6-0d42eee1a18a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:25.451398 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89cca520-f59e-41a1-99e6-0d42eee1a18a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:25.452385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89cca520-f59e-41a1-99e6-0d42eee1a18a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:25.453097 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89cca520-f59e-41a1-99e6-0d42eee1a18a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:25.453541 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89cca520-f59e-41a1-99e6-0d42eee1a18a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:25.453957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89cca520-f59e-41a1-99e6-0d42eee1a18a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:25.624601 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-89cca520-f59e-41a1-99e6-0d42eee1a18a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:25.634099 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-89cca520-f59e-41a1-99e6-0d42eee1a18a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:25.636132 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-89cca520-f59e-41a1-99e6-0d42eee1a18a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:25.637501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-89cca520-f59e-41a1-99e6-0d42eee1a18a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1735 microversion: 2.20 time: 0.198488 Sep 15 19:37:25.638210 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 768/1037] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:25 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:37:26.669735 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-aadacba6-435d-4d8e-8d2a-466fcbaa570b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:26.671082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-aadacba6-435d-4d8e-8d2a-466fcbaa570b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:26.678631 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aadacba6-435d-4d8e-8d2a-466fcbaa570b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:26.679469 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aadacba6-435d-4d8e-8d2a-466fcbaa570b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:26.680168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aadacba6-435d-4d8e-8d2a-466fcbaa570b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:26.681174 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aadacba6-435d-4d8e-8d2a-466fcbaa570b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:26.681845 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aadacba6-435d-4d8e-8d2a-466fcbaa570b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:26.682489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aadacba6-435d-4d8e-8d2a-466fcbaa570b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:26.843018 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-aadacba6-435d-4d8e-8d2a-466fcbaa570b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:26.852767 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-aadacba6-435d-4d8e-8d2a-466fcbaa570b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:26.854477 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-aadacba6-435d-4d8e-8d2a-466fcbaa570b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:26.855682 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-aadacba6-435d-4d8e-8d2a-466fcbaa570b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1735 microversion: 2.20 time: 0.189952 Sep 15 19:37:26.856536 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 769/1038] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:26 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:37:27.890912 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f6106144-eb75-402b-a200-64db2be840bd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:27.892001 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f6106144-eb75-402b-a200-64db2be840bd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:27.913721 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6106144-eb75-402b-a200-64db2be840bd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:27.914407 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6106144-eb75-402b-a200-64db2be840bd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:27.915024 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6106144-eb75-402b-a200-64db2be840bd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:27.916130 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6106144-eb75-402b-a200-64db2be840bd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:27.916911 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6106144-eb75-402b-a200-64db2be840bd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:27.917751 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6106144-eb75-402b-a200-64db2be840bd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:28.073518 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f6106144-eb75-402b-a200-64db2be840bd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:28.084205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f6106144-eb75-402b-a200-64db2be840bd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:28.086031 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f6106144-eb75-402b-a200-64db2be840bd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:28.088270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f6106144-eb75-402b-a200-64db2be840bd tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1735 microversion: 2.20 time: 0.205126 Sep 15 19:37:28.088975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 770/1039] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:27 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:29.114068 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6be9f2f6-dfea-4ff7-8780-02a76f45978c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:29.114742 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6be9f2f6-dfea-4ff7-8780-02a76f45978c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:29.121334 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6be9f2f6-dfea-4ff7-8780-02a76f45978c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:29.121804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6be9f2f6-dfea-4ff7-8780-02a76f45978c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:29.122229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6be9f2f6-dfea-4ff7-8780-02a76f45978c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:29.122921 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6be9f2f6-dfea-4ff7-8780-02a76f45978c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:29.123362 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6be9f2f6-dfea-4ff7-8780-02a76f45978c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:29.124005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6be9f2f6-dfea-4ff7-8780-02a76f45978c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:29.287994 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6be9f2f6-dfea-4ff7-8780-02a76f45978c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:29.301246 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6be9f2f6-dfea-4ff7-8780-02a76f45978c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:29.302800 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6be9f2f6-dfea-4ff7-8780-02a76f45978c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:29.304016 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6be9f2f6-dfea-4ff7-8780-02a76f45978c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1735 microversion: 2.20 time: 0.193915 Sep 15 19:37:29.304593 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 771/1040] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:29 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:30.329885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0ed2b450-4445-4c14-b0f8-2c90759dbf05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:30.330572 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0ed2b450-4445-4c14-b0f8-2c90759dbf05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:30.337069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ed2b450-4445-4c14-b0f8-2c90759dbf05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:30.337549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ed2b450-4445-4c14-b0f8-2c90759dbf05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:30.337983 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ed2b450-4445-4c14-b0f8-2c90759dbf05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:30.338708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ed2b450-4445-4c14-b0f8-2c90759dbf05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:30.339162 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ed2b450-4445-4c14-b0f8-2c90759dbf05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:30.339588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ed2b450-4445-4c14-b0f8-2c90759dbf05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:30.472890 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0ed2b450-4445-4c14-b0f8-2c90759dbf05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:30.481043 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0ed2b450-4445-4c14-b0f8-2c90759dbf05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:30.482488 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0ed2b450-4445-4c14-b0f8-2c90759dbf05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:30.483705 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0ed2b450-4445-4c14-b0f8-2c90759dbf05 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1735 microversion: 2.20 time: 0.157809 Sep 15 19:37:30.484274 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 772/1041] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:30 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:31.511188 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9cf914b9-bae7-4fdf-a751-6b2c9be05723 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:31.512189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9cf914b9-bae7-4fdf-a751-6b2c9be05723 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:31.520053 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cf914b9-bae7-4fdf-a751-6b2c9be05723 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:31.520533 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cf914b9-bae7-4fdf-a751-6b2c9be05723 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:31.520990 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cf914b9-bae7-4fdf-a751-6b2c9be05723 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:31.521662 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cf914b9-bae7-4fdf-a751-6b2c9be05723 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:31.522112 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cf914b9-bae7-4fdf-a751-6b2c9be05723 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:31.522534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cf914b9-bae7-4fdf-a751-6b2c9be05723 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:31.912438 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9cf914b9-bae7-4fdf-a751-6b2c9be05723 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:31.921291 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9cf914b9-bae7-4fdf-a751-6b2c9be05723 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:31.922750 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9cf914b9-bae7-4fdf-a751-6b2c9be05723 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:31.923965 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9cf914b9-bae7-4fdf-a751-6b2c9be05723 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1717 microversion: 2.20 time: 0.418764 Sep 15 19:37:31.924592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 773/1042] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:31 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1717 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:32.950182 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5f030d53-c2de-4424-ac2c-f48686bb66b2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:32.950884 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5f030d53-c2de-4424-ac2c-f48686bb66b2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:32.958161 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5f030d53-c2de-4424-ac2c-f48686bb66b2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:32.958639 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5f030d53-c2de-4424-ac2c-f48686bb66b2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:32.959059 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5f030d53-c2de-4424-ac2c-f48686bb66b2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:32.959814 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5f030d53-c2de-4424-ac2c-f48686bb66b2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:32.960304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5f030d53-c2de-4424-ac2c-f48686bb66b2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:32.960711 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5f030d53-c2de-4424-ac2c-f48686bb66b2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:33.106562 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5f030d53-c2de-4424-ac2c-f48686bb66b2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:33.115632 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5f030d53-c2de-4424-ac2c-f48686bb66b2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:33.117161 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5f030d53-c2de-4424-ac2c-f48686bb66b2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:33.118341 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5f030d53-c2de-4424-ac2c-f48686bb66b2 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1717 microversion: 2.20 time: 0.172280 Sep 15 19:37:33.118905 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 774/1043] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:32 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1717 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:34.142804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1801771a-0485-4b4b-942c-ef0f7adedd69 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:34.143467 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1801771a-0485-4b4b-942c-ef0f7adedd69 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:34.146157 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:37:34.150888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1801771a-0485-4b4b-942c-ef0f7adedd69 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:34.151371 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1801771a-0485-4b4b-942c-ef0f7adedd69 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:34.151848 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1801771a-0485-4b4b-942c-ef0f7adedd69 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:34.152551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1801771a-0485-4b4b-942c-ef0f7adedd69 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:34.153001 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1801771a-0485-4b4b-942c-ef0f7adedd69 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:34.153426 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1801771a-0485-4b4b-942c-ef0f7adedd69 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:34.175487 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:37:34.300205 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1801771a-0485-4b4b-942c-ef0f7adedd69 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:34.308688 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1801771a-0485-4b4b-942c-ef0f7adedd69 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:34.310133 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1801771a-0485-4b4b-942c-ef0f7adedd69 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:34.311465 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1801771a-0485-4b4b-942c-ef0f7adedd69 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1660 microversion: 2.20 time: 0.172807 Sep 15 19:37:34.312845 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 775/1044] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:34 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1660 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:34.336911 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e33cb452-ee95-426b-bdcd-623c23fb0f68 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4c32d15-a2d6-43ca-9ecc-a3b11ab98d1a"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:37:34.339260 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e33cb452-ee95-426b-bdcd-623c23fb0f68 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:34.345828 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e33cb452-ee95-426b-bdcd-623c23fb0f68 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:34.346319 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e33cb452-ee95-426b-bdcd-623c23fb0f68 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:34.346734 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e33cb452-ee95-426b-bdcd-623c23fb0f68 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:34.347425 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e33cb452-ee95-426b-bdcd-623c23fb0f68 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:34.347907 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e33cb452-ee95-426b-bdcd-623c23fb0f68 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:34.348338 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e33cb452-ee95-426b-bdcd-623c23fb0f68 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:35.389650 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e33cb452-ee95-426b-bdcd-623c23fb0f68 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "POST /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.056664 Sep 15 19:37:35.390327 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 776/1045] 10.222.0.18 () {62 vars in 1364 bytes} [Thu Sep 15 19:37:34 2022] POST /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/os-volume_attachments => generated 188 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 19:37:35.394936 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-c416faea-e10a-40e8-b8cc-152e37ac39b0 req-ac1282a0-0527-443f-a4bf-63babc4f63fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a46951e-b221-4405-8b11-ffa4fa53af9c", "name": "network-vif-unplugged", "status": "completed", "tag": "1f316119-2ccf-4680-9480-faced50dd6b6"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:37:35.406221 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c416faea-e10a-40e8-b8cc-152e37ac39b0 req-ac1282a0-0527-443f-a4bf-63babc4f63fa service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:35.406695 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c416faea-e10a-40e8-b8cc-152e37ac39b0 req-ac1282a0-0527-443f-a4bf-63babc4f63fa service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:35.407127 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c416faea-e10a-40e8-b8cc-152e37ac39b0 req-ac1282a0-0527-443f-a4bf-63babc4f63fa service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:35.417730 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.compute.server_external_events [req-c416faea-e10a-40e8-b8cc-152e37ac39b0 req-ac1282a0-0527-443f-a4bf-63babc4f63fa service nova] Unable to find a host for instance 0a46951e-b221-4405-8b11-ffa4fa53af9c. Dropping event network-vif-unplugged {{(pid=121041) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 15 19:37:35.419761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-c416faea-e10a-40e8-b8cc-152e37ac39b0 req-ac1282a0-0527-443f-a4bf-63babc4f63fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027367 Sep 15 19:37:35.419761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 777/1046] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 15 19:37:35.522051 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4af04f1b-085e-4ddd-8684-eed31238941c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:35.522482 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4af04f1b-085e-4ddd-8684-eed31238941c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:35.528583 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4af04f1b-085e-4ddd-8684-eed31238941c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:35.529078 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4af04f1b-085e-4ddd-8684-eed31238941c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:35.529514 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4af04f1b-085e-4ddd-8684-eed31238941c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:35.530731 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4af04f1b-085e-4ddd-8684-eed31238941c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:35.531178 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4af04f1b-085e-4ddd-8684-eed31238941c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:35.531627 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4af04f1b-085e-4ddd-8684-eed31238941c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:36.014523 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4af04f1b-085e-4ddd-8684-eed31238941c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/os-volume_attachments/d4c32d15-a2d6-43ca-9ecc-a3b11ab98d1a" status: 202 len: 0 microversion: 2.20 time: 0.496133 Sep 15 19:37:36.015125 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 778/1047] 10.222.0.18 () {60 vars in 1457 bytes} [Thu Sep 15 19:37:35 2022] DELETE /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/os-volume_attachments/d4c32d15-a2d6-43ca-9ecc-a3b11ab98d1a => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 19:37:36.079876 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-946b12a9-7c56-40b6-a307-1d4aff54c1fc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:37:36.080465 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-946b12a9-7c56-40b6-a307-1d4aff54c1fc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:36.086480 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-946b12a9-7c56-40b6-a307-1d4aff54c1fc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:36.086957 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-946b12a9-7c56-40b6-a307-1d4aff54c1fc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:36.087388 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-946b12a9-7c56-40b6-a307-1d4aff54c1fc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:36.088111 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-946b12a9-7c56-40b6-a307-1d4aff54c1fc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:36.088560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-946b12a9-7c56-40b6-a307-1d4aff54c1fc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:36.088970 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-946b12a9-7c56-40b6-a307-1d4aff54c1fc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:36.120265 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-946b12a9-7c56-40b6-a307-1d4aff54c1fc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121041) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 19:37:36.444596 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-946b12a9-7c56-40b6-a307-1d4aff54c1fc tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "POST /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/action" status: 202 len: 0 microversion: 2.20 time: 0.369622 Sep 15 19:37:36.445424 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 779/1048] 10.222.0.18 () {62 vars in 1319 bytes} [Thu Sep 15 19:37:36 2022] POST /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 19:37:36.453834 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ae7b1c03-1531-4f4e-a7ae-0dba52cac654 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:36.454450 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ae7b1c03-1531-4f4e-a7ae-0dba52cac654 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:36.460481 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae7b1c03-1531-4f4e-a7ae-0dba52cac654 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:36.460970 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae7b1c03-1531-4f4e-a7ae-0dba52cac654 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:36.461410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae7b1c03-1531-4f4e-a7ae-0dba52cac654 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:36.462107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae7b1c03-1531-4f4e-a7ae-0dba52cac654 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:36.462558 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae7b1c03-1531-4f4e-a7ae-0dba52cac654 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:36.462983 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae7b1c03-1531-4f4e-a7ae-0dba52cac654 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:36.598600 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ae7b1c03-1531-4f4e-a7ae-0dba52cac654 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:36.608249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ae7b1c03-1531-4f4e-a7ae-0dba52cac654 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:36.609745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ae7b1c03-1531-4f4e-a7ae-0dba52cac654 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:36.610975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ae7b1c03-1531-4f4e-a7ae-0dba52cac654 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1668 microversion: 2.20 time: 0.161616 Sep 15 19:37:36.611565 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 780/1049] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:36 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:37.636232 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ef33540e-f604-43d8-862c-8b9d64296b55 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:37.636866 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ef33540e-f604-43d8-862c-8b9d64296b55 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:37.643986 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef33540e-f604-43d8-862c-8b9d64296b55 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:37.645069 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef33540e-f604-43d8-862c-8b9d64296b55 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:37.645503 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef33540e-f604-43d8-862c-8b9d64296b55 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:37.646189 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef33540e-f604-43d8-862c-8b9d64296b55 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:37.646730 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef33540e-f604-43d8-862c-8b9d64296b55 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:37.647055 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ef33540e-f604-43d8-862c-8b9d64296b55 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:37.781681 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ef33540e-f604-43d8-862c-8b9d64296b55 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:37.789855 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ef33540e-f604-43d8-862c-8b9d64296b55 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:37.791286 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ef33540e-f604-43d8-862c-8b9d64296b55 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:37.792454 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ef33540e-f604-43d8-862c-8b9d64296b55 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1668 microversion: 2.20 time: 0.160174 Sep 15 19:37:37.793015 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 781/1050] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:37 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:38.817551 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-46d3e0eb-8413-4b18-ad28-26ed3fc43ac1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:38.818508 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-46d3e0eb-8413-4b18-ad28-26ed3fc43ac1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:38.825381 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46d3e0eb-8413-4b18-ad28-26ed3fc43ac1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:38.825808 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46d3e0eb-8413-4b18-ad28-26ed3fc43ac1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:38.826249 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46d3e0eb-8413-4b18-ad28-26ed3fc43ac1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:38.826981 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46d3e0eb-8413-4b18-ad28-26ed3fc43ac1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:38.827431 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46d3e0eb-8413-4b18-ad28-26ed3fc43ac1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:38.827885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46d3e0eb-8413-4b18-ad28-26ed3fc43ac1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:39.047885 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-46d3e0eb-8413-4b18-ad28-26ed3fc43ac1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:39.056475 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-46d3e0eb-8413-4b18-ad28-26ed3fc43ac1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:39.057803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-46d3e0eb-8413-4b18-ad28-26ed3fc43ac1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:39.059085 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-46d3e0eb-8413-4b18-ad28-26ed3fc43ac1 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1726 microversion: 2.20 time: 0.245731 Sep 15 19:37:39.059785 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 782/1051] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:38 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1726 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:40.087093 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1e8ca49c-74c0-4ee3-bf8f-48195a59b1aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:40.088120 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1e8ca49c-74c0-4ee3-bf8f-48195a59b1aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:40.095337 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e8ca49c-74c0-4ee3-bf8f-48195a59b1aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:40.098311 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e8ca49c-74c0-4ee3-bf8f-48195a59b1aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:40.099041 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e8ca49c-74c0-4ee3-bf8f-48195a59b1aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:40.099802 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e8ca49c-74c0-4ee3-bf8f-48195a59b1aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:40.103611 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e8ca49c-74c0-4ee3-bf8f-48195a59b1aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:40.103611 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e8ca49c-74c0-4ee3-bf8f-48195a59b1aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:40.242480 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1e8ca49c-74c0-4ee3-bf8f-48195a59b1aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:40.252783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1e8ca49c-74c0-4ee3-bf8f-48195a59b1aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:40.254766 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1e8ca49c-74c0-4ee3-bf8f-48195a59b1aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:40.256414 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1e8ca49c-74c0-4ee3-bf8f-48195a59b1aa tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1726 microversion: 2.20 time: 0.173352 Sep 15 19:37:40.257769 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 783/1052] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:40 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:41.283121 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6e889941-3e6c-493f-a916-cf51b61a8071 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:41.284497 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6e889941-3e6c-493f-a916-cf51b61a8071 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:41.291246 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e889941-3e6c-493f-a916-cf51b61a8071 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:41.291761 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e889941-3e6c-493f-a916-cf51b61a8071 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:41.292194 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e889941-3e6c-493f-a916-cf51b61a8071 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:41.293208 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e889941-3e6c-493f-a916-cf51b61a8071 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:41.293715 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e889941-3e6c-493f-a916-cf51b61a8071 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:41.294137 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e889941-3e6c-493f-a916-cf51b61a8071 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:41.443755 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6e889941-3e6c-493f-a916-cf51b61a8071 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:41.452748 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6e889941-3e6c-493f-a916-cf51b61a8071 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:41.454575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6e889941-3e6c-493f-a916-cf51b61a8071 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:41.455944 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6e889941-3e6c-493f-a916-cf51b61a8071 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1726 microversion: 2.20 time: 0.176728 Sep 15 19:37:41.456861 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 784/1053] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:41 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:42.486389 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ce73e255-1437-44ee-b5c0-3c300a80c990 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:42.488635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ce73e255-1437-44ee-b5c0-3c300a80c990 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:42.499740 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce73e255-1437-44ee-b5c0-3c300a80c990 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:42.500698 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce73e255-1437-44ee-b5c0-3c300a80c990 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:42.501549 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce73e255-1437-44ee-b5c0-3c300a80c990 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:42.502420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce73e255-1437-44ee-b5c0-3c300a80c990 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:42.503020 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce73e255-1437-44ee-b5c0-3c300a80c990 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:42.503599 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce73e255-1437-44ee-b5c0-3c300a80c990 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:42.669623 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ce73e255-1437-44ee-b5c0-3c300a80c990 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:42.682485 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ce73e255-1437-44ee-b5c0-3c300a80c990 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:42.684278 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ce73e255-1437-44ee-b5c0-3c300a80c990 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:42.685495 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ce73e255-1437-44ee-b5c0-3c300a80c990 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1726 microversion: 2.20 time: 0.207260 Sep 15 19:37:42.686807 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 785/1054] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:42 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1726 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:37:43.714492 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b48cb28f-c130-4ee0-889c-c6a876af4649 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:43.715275 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b48cb28f-c130-4ee0-889c-c6a876af4649 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:43.723251 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b48cb28f-c130-4ee0-889c-c6a876af4649 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:43.723760 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b48cb28f-c130-4ee0-889c-c6a876af4649 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:43.724196 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b48cb28f-c130-4ee0-889c-c6a876af4649 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:43.724930 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b48cb28f-c130-4ee0-889c-c6a876af4649 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:43.725403 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b48cb28f-c130-4ee0-889c-c6a876af4649 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:43.725817 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b48cb28f-c130-4ee0-889c-c6a876af4649 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:43.882708 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b48cb28f-c130-4ee0-889c-c6a876af4649 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:43.884967 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:37:43.893236 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b48cb28f-c130-4ee0-889c-c6a876af4649 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:43.894801 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b48cb28f-c130-4ee0-889c-c6a876af4649 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:43.895945 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b48cb28f-c130-4ee0-889c-c6a876af4649 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1726 microversion: 2.20 time: 0.187307 Sep 15 19:37:43.914333 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 786/1055] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:43 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1726 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:44.922051 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7e88354c-6c6f-4ec8-b7d2-fc9e146db425 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:44.922779 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7e88354c-6c6f-4ec8-b7d2-fc9e146db425 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:44.930569 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e88354c-6c6f-4ec8-b7d2-fc9e146db425 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:44.931061 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e88354c-6c6f-4ec8-b7d2-fc9e146db425 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:44.931499 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e88354c-6c6f-4ec8-b7d2-fc9e146db425 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:44.932476 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e88354c-6c6f-4ec8-b7d2-fc9e146db425 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:44.932973 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e88354c-6c6f-4ec8-b7d2-fc9e146db425 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:44.933401 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e88354c-6c6f-4ec8-b7d2-fc9e146db425 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:45.083794 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7e88354c-6c6f-4ec8-b7d2-fc9e146db425 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:45.092566 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7e88354c-6c6f-4ec8-b7d2-fc9e146db425 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:45.094066 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7e88354c-6c6f-4ec8-b7d2-fc9e146db425 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:45.095252 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7e88354c-6c6f-4ec8-b7d2-fc9e146db425 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1726 microversion: 2.20 time: 0.177482 Sep 15 19:37:45.095849 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 787/1056] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:44 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:46.123040 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9ab83397-1968-40f3-9394-2a1888a8d3b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:46.124418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9ab83397-1968-40f3-9394-2a1888a8d3b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:46.130646 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9ab83397-1968-40f3-9394-2a1888a8d3b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:46.135609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9ab83397-1968-40f3-9394-2a1888a8d3b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:46.135609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9ab83397-1968-40f3-9394-2a1888a8d3b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:46.135609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9ab83397-1968-40f3-9394-2a1888a8d3b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:46.135609 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9ab83397-1968-40f3-9394-2a1888a8d3b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:46.136065 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9ab83397-1968-40f3-9394-2a1888a8d3b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:46.282310 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9ab83397-1968-40f3-9394-2a1888a8d3b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:46.303445 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9ab83397-1968-40f3-9394-2a1888a8d3b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:46.306129 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9ab83397-1968-40f3-9394-2a1888a8d3b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:46.308176 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9ab83397-1968-40f3-9394-2a1888a8d3b7 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1726 microversion: 2.20 time: 0.189259 Sep 15 19:37:46.319116 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 788/1057] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:46 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:47.334729 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-73bfc7e9-2419-4210-a99c-574d1d6b136c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:47.335331 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-73bfc7e9-2419-4210-a99c-574d1d6b136c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:47.342318 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73bfc7e9-2419-4210-a99c-574d1d6b136c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:47.342934 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73bfc7e9-2419-4210-a99c-574d1d6b136c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:47.343281 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73bfc7e9-2419-4210-a99c-574d1d6b136c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:47.343993 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73bfc7e9-2419-4210-a99c-574d1d6b136c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:47.344440 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73bfc7e9-2419-4210-a99c-574d1d6b136c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:47.344857 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73bfc7e9-2419-4210-a99c-574d1d6b136c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:47.479922 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-73bfc7e9-2419-4210-a99c-574d1d6b136c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:47.489671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-73bfc7e9-2419-4210-a99c-574d1d6b136c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:47.492366 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-73bfc7e9-2419-4210-a99c-574d1d6b136c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:47.492366 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-73bfc7e9-2419-4210-a99c-574d1d6b136c tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1726 microversion: 2.20 time: 0.161617 Sep 15 19:37:47.492916 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 789/1058] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:47 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:48.518824 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ff15f708-d334-4874-8d7b-ebaa9d51f0d8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:48.519521 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ff15f708-d334-4874-8d7b-ebaa9d51f0d8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:48.526385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff15f708-d334-4874-8d7b-ebaa9d51f0d8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:48.526868 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff15f708-d334-4874-8d7b-ebaa9d51f0d8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:48.527484 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff15f708-d334-4874-8d7b-ebaa9d51f0d8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:48.528218 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff15f708-d334-4874-8d7b-ebaa9d51f0d8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:48.528837 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff15f708-d334-4874-8d7b-ebaa9d51f0d8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:48.529255 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff15f708-d334-4874-8d7b-ebaa9d51f0d8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:48.664939 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ff15f708-d334-4874-8d7b-ebaa9d51f0d8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:48.674344 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ff15f708-d334-4874-8d7b-ebaa9d51f0d8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:48.675820 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ff15f708-d334-4874-8d7b-ebaa9d51f0d8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:48.676977 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ff15f708-d334-4874-8d7b-ebaa9d51f0d8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1726 microversion: 2.20 time: 0.162649 Sep 15 19:37:48.677560 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 790/1059] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:48 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 19:37:49.702418 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3b3c3c05-ffb4-4f8d-9e14-fe423396f4a0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:49.703803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3b3c3c05-ffb4-4f8d-9e14-fe423396f4a0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:49.710765 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b3c3c05-ffb4-4f8d-9e14-fe423396f4a0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:49.711300 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b3c3c05-ffb4-4f8d-9e14-fe423396f4a0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:49.711790 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b3c3c05-ffb4-4f8d-9e14-fe423396f4a0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:49.712486 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b3c3c05-ffb4-4f8d-9e14-fe423396f4a0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:49.712974 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b3c3c05-ffb4-4f8d-9e14-fe423396f4a0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:49.713480 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b3c3c05-ffb4-4f8d-9e14-fe423396f4a0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:49.861022 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3b3c3c05-ffb4-4f8d-9e14-fe423396f4a0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:49.870555 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3b3c3c05-ffb4-4f8d-9e14-fe423396f4a0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:49.872413 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3b3c3c05-ffb4-4f8d-9e14-fe423396f4a0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:49.873975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3b3c3c05-ffb4-4f8d-9e14-fe423396f4a0 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1726 microversion: 2.20 time: 0.175707 Sep 15 19:37:49.874660 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 791/1060] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:49 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:50.594773 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-1c0b9fb9-b8cd-4b7c-8df4-9940a2749531 req-350ceef5-1f2c-420c-8d44-42e2c72117bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a46951e-b221-4405-8b11-ffa4fa53af9c", "name": "network-vif-plugged", "status": "completed", "tag": "1f316119-2ccf-4680-9480-faced50dd6b6"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:37:50.604984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-1c0b9fb9-b8cd-4b7c-8df4-9940a2749531 req-350ceef5-1f2c-420c-8d44-42e2c72117bc service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:50.607868 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-1c0b9fb9-b8cd-4b7c-8df4-9940a2749531 req-350ceef5-1f2c-420c-8d44-42e2c72117bc service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:50.607868 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-1c0b9fb9-b8cd-4b7c-8df4-9940a2749531 req-350ceef5-1f2c-420c-8d44-42e2c72117bc service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:50.617053 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-1c0b9fb9-b8cd-4b7c-8df4-9940a2749531 req-350ceef5-1f2c-420c-8d44-42e2c72117bc service nova] Creating event network-vif-plugged:1f316119-2ccf-4680-9480-faced50dd6b6 for instance 0a46951e-b221-4405-8b11-ffa4fa53af9c on hv-cinder-84984 Sep 15 19:37:50.622605 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-1c0b9fb9-b8cd-4b7c-8df4-9940a2749531 req-350ceef5-1f2c-420c-8d44-42e2c72117bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098440 Sep 15 19:37:50.623185 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 792/1061] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:37:50.899973 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-31654dd3-1f51-4bef-9d54-ebf831ed1371 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:50.900692 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-31654dd3-1f51-4bef-9d54-ebf831ed1371 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:50.907888 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-31654dd3-1f51-4bef-9d54-ebf831ed1371 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:50.908480 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-31654dd3-1f51-4bef-9d54-ebf831ed1371 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:50.908928 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-31654dd3-1f51-4bef-9d54-ebf831ed1371 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:50.909624 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-31654dd3-1f51-4bef-9d54-ebf831ed1371 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:50.910072 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-31654dd3-1f51-4bef-9d54-ebf831ed1371 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:50.910492 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-31654dd3-1f51-4bef-9d54-ebf831ed1371 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:51.097778 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-31654dd3-1f51-4bef-9d54-ebf831ed1371 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:51.106229 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-31654dd3-1f51-4bef-9d54-ebf831ed1371 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:51.107914 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-31654dd3-1f51-4bef-9d54-ebf831ed1371 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:51.109080 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-31654dd3-1f51-4bef-9d54-ebf831ed1371 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1726 microversion: 2.20 time: 0.213541 Sep 15 19:37:51.109659 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 793/1062] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:50 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:52.136006 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fa6d489c-79f3-4813-8874-eabf58f73c40 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:52.136735 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fa6d489c-79f3-4813-8874-eabf58f73c40 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:52.143673 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa6d489c-79f3-4813-8874-eabf58f73c40 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:52.144169 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa6d489c-79f3-4813-8874-eabf58f73c40 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:52.144603 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa6d489c-79f3-4813-8874-eabf58f73c40 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:52.145339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa6d489c-79f3-4813-8874-eabf58f73c40 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:52.145747 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa6d489c-79f3-4813-8874-eabf58f73c40 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:52.146171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa6d489c-79f3-4813-8874-eabf58f73c40 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:52.284401 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fa6d489c-79f3-4813-8874-eabf58f73c40 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:52.293124 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fa6d489c-79f3-4813-8874-eabf58f73c40 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:52.294575 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fa6d489c-79f3-4813-8874-eabf58f73c40 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:52.295783 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fa6d489c-79f3-4813-8874-eabf58f73c40 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1726 microversion: 2.20 time: 0.163910 Sep 15 19:37:52.296347 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 794/1063] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:52 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:53.320915 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c8a61e2e-6052-4175-ac31-7fc7b6e789fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:53.321588 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c8a61e2e-6052-4175-ac31-7fc7b6e789fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:53.328020 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c8a61e2e-6052-4175-ac31-7fc7b6e789fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:53.328501 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c8a61e2e-6052-4175-ac31-7fc7b6e789fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:53.328939 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c8a61e2e-6052-4175-ac31-7fc7b6e789fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:53.329652 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c8a61e2e-6052-4175-ac31-7fc7b6e789fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:53.330125 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c8a61e2e-6052-4175-ac31-7fc7b6e789fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:53.330571 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c8a61e2e-6052-4175-ac31-7fc7b6e789fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:53.466991 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c8a61e2e-6052-4175-ac31-7fc7b6e789fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:53.476392 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c8a61e2e-6052-4175-ac31-7fc7b6e789fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:53.477852 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c8a61e2e-6052-4175-ac31-7fc7b6e789fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:53.479035 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c8a61e2e-6052-4175-ac31-7fc7b6e789fe tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1726 microversion: 2.20 time: 0.162437 Sep 15 19:37:53.479604 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 795/1064] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:53 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:37:54.504906 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4a8dee42-4d5f-44f2-b1ba-7241e05c4c02 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:37:54.505579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4a8dee42-4d5f-44f2-b1ba-7241e05c4c02 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:37:54.511975 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a8dee42-4d5f-44f2-b1ba-7241e05c4c02 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:54.513875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a8dee42-4d5f-44f2-b1ba-7241e05c4c02 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:54.513875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a8dee42-4d5f-44f2-b1ba-7241e05c4c02 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:54.513875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a8dee42-4d5f-44f2-b1ba-7241e05c4c02 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:37:54.514173 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a8dee42-4d5f-44f2-b1ba-7241e05c4c02 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:37:54.514412 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a8dee42-4d5f-44f2-b1ba-7241e05c4c02 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:37:54.645325 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4a8dee42-4d5f-44f2-b1ba-7241e05c4c02 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:54.653460 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4a8dee42-4d5f-44f2-b1ba-7241e05c4c02 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:54.654904 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4a8dee42-4d5f-44f2-b1ba-7241e05c4c02 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:37:54.656070 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4a8dee42-4d5f-44f2-b1ba-7241e05c4c02 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1713 microversion: 2.20 time: 0.155034 Sep 15 19:37:54.656628 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 796/1065] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:37:54 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:38:25.604532 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-976bf756-73d9-4423-b643-77f6ddfa892b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:25.606555 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-976bf756-73d9-4423-b643-77f6ddfa892b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:38:25.608984 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:38:25.609649 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=57 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:38:25.614373 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-976bf756-73d9-4423-b643-77f6ddfa892b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:25.618803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-976bf756-73d9-4423-b643-77f6ddfa892b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:25.618803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-976bf756-73d9-4423-b643-77f6ddfa892b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:25.618803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-976bf756-73d9-4423-b643-77f6ddfa892b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:25.618803 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-976bf756-73d9-4423-b643-77f6ddfa892b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:25.619240 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-976bf756-73d9-4423-b643-77f6ddfa892b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:25.647314 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-976bf756-73d9-4423-b643-77f6ddfa892b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047530 Sep 15 19:38:25.647894 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 797/1066] 10.222.0.18 () {60 vars in 1343 bytes} [Thu Sep 15 19:38:25 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:38:25.711279 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-84335b6f-e2d5-475a-a4c5-5dcd56c7e4ab tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:25.711812 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-84335b6f-e2d5-475a-a4c5-5dcd56c7e4ab tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:38:25.718022 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84335b6f-e2d5-475a-a4c5-5dcd56c7e4ab tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:25.718504 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84335b6f-e2d5-475a-a4c5-5dcd56c7e4ab tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:25.718941 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84335b6f-e2d5-475a-a4c5-5dcd56c7e4ab tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:25.719635 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84335b6f-e2d5-475a-a4c5-5dcd56c7e4ab tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:25.720224 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84335b6f-e2d5-475a-a4c5-5dcd56c7e4ab tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:25.720656 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84335b6f-e2d5-475a-a4c5-5dcd56c7e4ab tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:25.746111 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-84335b6f-e2d5-475a-a4c5-5dcd56c7e4ab tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 19:38:25.980084 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-84335b6f-e2d5-475a-a4c5-5dcd56c7e4ab tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 204 len: 0 microversion: 2.20 time: 0.272797 Sep 15 19:38:25.980839 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 798/1067] 10.222.0.18 () {60 vars in 1280 bytes} [Thu Sep 15 19:38:25 2022] DELETE /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 15 19:38:25.989369 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fe6c7db1-bf1c-484a-a3d6-ae730413ef6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:25.990175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fe6c7db1-bf1c-484a-a3d6-ae730413ef6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:38:25.996908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe6c7db1-bf1c-484a-a3d6-ae730413ef6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:25.997385 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe6c7db1-bf1c-484a-a3d6-ae730413ef6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:25.997819 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe6c7db1-bf1c-484a-a3d6-ae730413ef6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:25.998504 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe6c7db1-bf1c-484a-a3d6-ae730413ef6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:25.998950 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe6c7db1-bf1c-484a-a3d6-ae730413ef6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:25.999698 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fe6c7db1-bf1c-484a-a3d6-ae730413ef6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:26.132543 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fe6c7db1-bf1c-484a-a3d6-ae730413ef6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:38:26.140958 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fe6c7db1-bf1c-484a-a3d6-ae730413ef6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:38:26.142411 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fe6c7db1-bf1c-484a-a3d6-ae730413ef6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:38:26.143568 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fe6c7db1-bf1c-484a-a3d6-ae730413ef6a tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1719 microversion: 2.20 time: 0.158246 Sep 15 19:38:26.144175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 799/1068] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:38:25 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:38:27.169513 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-743d557a-cb28-465a-a4a9-830071d2f06d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:27.170255 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-743d557a-cb28-465a-a4a9-830071d2f06d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:38:27.176889 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-743d557a-cb28-465a-a4a9-830071d2f06d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:27.177364 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-743d557a-cb28-465a-a4a9-830071d2f06d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:27.177794 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-743d557a-cb28-465a-a4a9-830071d2f06d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:27.178506 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-743d557a-cb28-465a-a4a9-830071d2f06d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:27.179003 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-743d557a-cb28-465a-a4a9-830071d2f06d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:27.179361 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-743d557a-cb28-465a-a4a9-830071d2f06d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:27.353489 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-743d557a-cb28-465a-a4a9-830071d2f06d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:38:27.362473 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-743d557a-cb28-465a-a4a9-830071d2f06d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:38:27.363951 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-743d557a-cb28-465a-a4a9-830071d2f06d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:38:27.365115 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-743d557a-cb28-465a-a4a9-830071d2f06d tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1719 microversion: 2.20 time: 0.199602 Sep 15 19:38:27.365668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 800/1069] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:38:27 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1719 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:38:28.276758 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-4b16b1ee-dfbd-4c36-92cc-b0036223277d req-b0f006b8-b6b0-4d39-acaf-245de81560a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a46951e-b221-4405-8b11-ffa4fa53af9c", "name": "network-vif-deleted", "tag": "1f316119-2ccf-4680-9480-faced50dd6b6"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 19:38:28.288958 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4b16b1ee-dfbd-4c36-92cc-b0036223277d req-b0f006b8-b6b0-4d39-acaf-245de81560a7 service nova] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:28.289446 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4b16b1ee-dfbd-4c36-92cc-b0036223277d req-b0f006b8-b6b0-4d39-acaf-245de81560a7 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:28.289873 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4b16b1ee-dfbd-4c36-92cc-b0036223277d req-b0f006b8-b6b0-4d39-acaf-245de81560a7 service nova] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:28.301812 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-4b16b1ee-dfbd-4c36-92cc-b0036223277d req-b0f006b8-b6b0-4d39-acaf-245de81560a7 service nova] Creating event network-vif-deleted:1f316119-2ccf-4680-9480-faced50dd6b6 for instance 0a46951e-b221-4405-8b11-ffa4fa53af9c on hv-cinder-84984 Sep 15 19:38:28.307086 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-4b16b1ee-dfbd-4c36-92cc-b0036223277d req-b0f006b8-b6b0-4d39-acaf-245de81560a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092820 Sep 15 19:38:28.309592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 801/1070] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 15 19:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:38:28.391567 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7e0079e8-73aa-48b6-9696-d9d79413459b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:28.392309 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7e0079e8-73aa-48b6-9696-d9d79413459b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:38:28.399598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e0079e8-73aa-48b6-9696-d9d79413459b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:28.400116 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e0079e8-73aa-48b6-9696-d9d79413459b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:28.400545 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e0079e8-73aa-48b6-9696-d9d79413459b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:28.401382 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e0079e8-73aa-48b6-9696-d9d79413459b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:28.401840 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e0079e8-73aa-48b6-9696-d9d79413459b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:28.402261 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e0079e8-73aa-48b6-9696-d9d79413459b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:28.473701 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7e0079e8-73aa-48b6-9696-d9d79413459b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:38:28.482305 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7e0079e8-73aa-48b6-9696-d9d79413459b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:38:28.483850 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7e0079e8-73aa-48b6-9696-d9d79413459b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '250673e17f40455ca2c5e0036f5a9e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427b697da1034408811e994e22d4f592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 19:38:28.485119 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7e0079e8-73aa-48b6-9696-d9d79413459b tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 200 len: 1652 microversion: 2.20 time: 0.097998 Sep 15 19:38:28.485713 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 802/1071] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:38:28 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 1652 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 19:38:29.512380 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5ecd0436-5b83-4797-b101-86881e430ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:29.512994 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5ecd0436-5b83-4797-b101-86881e430ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:38:29.519507 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ecd0436-5b83-4797-b101-86881e430ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:29.520024 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ecd0436-5b83-4797-b101-86881e430ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:29.520458 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ecd0436-5b83-4797-b101-86881e430ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:29.521145 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ecd0436-5b83-4797-b101-86881e430ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:29.521793 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ecd0436-5b83-4797-b101-86881e430ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:29.522211 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ecd0436-5b83-4797-b101-86881e430ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:29.536231 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-5ecd0436-5b83-4797-b101-86881e430ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] HTTP exception thrown: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5ecd0436-5b83-4797-b101-86881e430ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Request method failure captured: Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c HTTP/1.1 Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI33t9Ff3TC6CaCfsx0czw0aBn8SD971R6_ioWsuVVpNi0zF2ESYXoxIEUvDbAOOWHRzz6oHuCdf4_2RqqNhP9mQ77-EY60fPpMohdukHLgEyEJbXI4R1rkdi1l6pQ2kJrSca9C5Bbpsq4E43x0mAZRVDcBBcWGVxYLA04vtN3Vi6GMI Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 427b697da1034408811e994e22d4f592 Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:38:29.537879 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:38:29.539804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_427b697da1034408811e994e22d4f592", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/427b697da1034408811e994e22d4f592"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/427b697da1034408811e994e22d4f592"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/427b697da1034408811e994e22d4f592"}]}] Sep 15 19:38:29.539804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:29.539804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 427b697da1034408811e994e22d4f592 Sep 15 19:38:29.539804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:29.539804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeShelveTestJSON-357440265-project Sep 15 19:38:29.539804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:38:29.539804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:38:29.539804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 250673e17f40455ca2c5e0036f5a9e3c Sep 15 19:38:29.539804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeShelveTestJSON-357440265-project Sep 15 19:38:29.539804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:38:29.539804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:29.539804 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '0a46951e-b221-4405-8b11-ffa4fa53af9c'} Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:38:29.540733 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:29.542304 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:29.543815 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5ecd0436-5b83-4797-b101-86881e430ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Returning 404 to user: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:38:29.543815 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5ecd0436-5b83-4797-b101-86881e430ec8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 404 len: 111 microversion: 2.20 time: 0.031444 Sep 15 19:38:29.543815 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 803/1072] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:38:29 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 15 19:38:29.548194 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-87ed8d71-4079-4325-a052-c10a8e432d75 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '.version_select at 0x7f551ec67280>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:29.650006 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-87ed8d71-4079-4325-a052-c10a8e432d75 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-754287024" status: 204 len: 0 microversion: 2.20 time: 0.105251 Sep 15 19:38:29.650710 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 804/1073] 10.222.0.18 () {60 vars in 1259 bytes} [Thu Sep 15 19:38:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-754287024 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 19:38:31.876171 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2a998573-b1ff-4c08-af9b-ea88a83117b8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:31.876782 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2a998573-b1ff-4c08-af9b-ea88a83117b8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:38:31.883499 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a998573-b1ff-4c08-af9b-ea88a83117b8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:31.884007 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a998573-b1ff-4c08-af9b-ea88a83117b8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:31.884477 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a998573-b1ff-4c08-af9b-ea88a83117b8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:31.885299 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a998573-b1ff-4c08-af9b-ea88a83117b8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:31.885798 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a998573-b1ff-4c08-af9b-ea88a83117b8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:31.886227 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2a998573-b1ff-4c08-af9b-ea88a83117b8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:31.899613 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-2a998573-b1ff-4c08-af9b-ea88a83117b8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] HTTP exception thrown: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2a998573-b1ff-4c08-af9b-ea88a83117b8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Request method failure captured: Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c HTTP/1.1 Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI33t9Ff3TC6CaCfsx0czw0aBn8SD971R6_ioWsuVVpNi0zF2ESYXoxIEUvDbAOOWHRzz6oHuCdf4_2RqqNhP9mQ77-EY60fPpMohdukHLgEyEJbXI4R1rkdi1l6pQ2kJrSca9C5Bbpsq4E43x0mAZRVDcBBcWGVxYLA04vtN3Vi6GMI Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 427b697da1034408811e994e22d4f592 Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:38:31.901270 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:38:31.903030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_427b697da1034408811e994e22d4f592", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/427b697da1034408811e994e22d4f592"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/427b697da1034408811e994e22d4f592"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/427b697da1034408811e994e22d4f592"}]}] Sep 15 19:38:31.903030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:31.903030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 427b697da1034408811e994e22d4f592 Sep 15 19:38:31.903030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:31.903030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeShelveTestJSON-357440265-project Sep 15 19:38:31.903030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:38:31.903030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:38:31.903030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 250673e17f40455ca2c5e0036f5a9e3c Sep 15 19:38:31.903030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeShelveTestJSON-357440265-project Sep 15 19:38:31.903030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:38:31.903030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:31.903030 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '0a46951e-b221-4405-8b11-ffa4fa53af9c'} Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:38:31.903963 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:31.905420 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:31.906875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2a998573-b1ff-4c08-af9b-ea88a83117b8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Returning 404 to user: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:38:31.906875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2a998573-b1ff-4c08-af9b-ea88a83117b8 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 404 len: 111 microversion: 2.20 time: 0.031027 Sep 15 19:38:31.906875 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 805/1074] 10.222.0.18 () {60 vars in 1280 bytes} [Thu Sep 15 19:38:31 2022] DELETE /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 15 19:38:31.911259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-97419149-0972-4d72-82f5-b18739885be6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:31.912144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-97419149-0972-4d72-82f5-b18739885be6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: 0a46951e-b221-4405-8b11-ffa4fa53af9c] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:38:31.918740 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97419149-0972-4d72-82f5-b18739885be6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:31.919220 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97419149-0972-4d72-82f5-b18739885be6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:31.919671 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97419149-0972-4d72-82f5-b18739885be6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:31.920462 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97419149-0972-4d72-82f5-b18739885be6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:31.920915 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97419149-0972-4d72-82f5-b18739885be6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:31.921339 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97419149-0972-4d72-82f5-b18739885be6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:31.936042 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-97419149-0972-4d72-82f5-b18739885be6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] HTTP exception thrown: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-97419149-0972-4d72-82f5-b18739885be6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Request method failure captured: Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c HTTP/1.1 Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI33t9Ff3TC6CaCfsx0czw0aBn8SD971R6_ioWsuVVpNi0zF2ESYXoxIEUvDbAOOWHRzz6oHuCdf4_2RqqNhP9mQ77-EY60fPpMohdukHLgEyEJbXI4R1rkdi1l6pQ2kJrSca9C5Bbpsq4E43x0mAZRVDcBBcWGVxYLA04vtN3Vi6GMI Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 427b697da1034408811e994e22d4f592 Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:38:31.937592 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:38:31.939296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_427b697da1034408811e994e22d4f592", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/427b697da1034408811e994e22d4f592"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/427b697da1034408811e994e22d4f592"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/427b697da1034408811e994e22d4f592"}]}] Sep 15 19:38:31.939296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:31.939296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 427b697da1034408811e994e22d4f592 Sep 15 19:38:31.939296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:31.939296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeShelveTestJSON-357440265-project Sep 15 19:38:31.939296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:38:31.939296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:38:31.939296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 250673e17f40455ca2c5e0036f5a9e3c Sep 15 19:38:31.939296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeShelveTestJSON-357440265-project Sep 15 19:38:31.939296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:38:31.939296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:31.939296 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': '0a46951e-b221-4405-8b11-ffa4fa53af9c'} Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:38:31.940175 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. Sep 15 19:38:31.941410 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:31.942826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-97419149-0972-4d72-82f5-b18739885be6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Returning 404 to user: Instance 0a46951e-b221-4405-8b11-ffa4fa53af9c could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:38:31.942826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-97419149-0972-4d72-82f5-b18739885be6 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c" status: 404 len: 111 microversion: 2.20 time: 0.031560 Sep 15 19:38:31.942826 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 806/1075] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:38:31 2022] GET /compute/v2.1/servers/0a46951e-b221-4405-8b11-ffa4fa53af9c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 15 19:38:33.349435 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e952bb7d-8809-4008-8d86-35920f68c196 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:33.350198 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e952bb7d-8809-4008-8d86-35920f68c196 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:38:33.360168 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e952bb7d-8809-4008-8d86-35920f68c196 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:33.360646 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e952bb7d-8809-4008-8d86-35920f68c196 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:33.361077 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e952bb7d-8809-4008-8d86-35920f68c196 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:33.361777 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e952bb7d-8809-4008-8d86-35920f68c196 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:33.362228 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e952bb7d-8809-4008-8d86-35920f68c196 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:33.362643 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e952bb7d-8809-4008-8d86-35920f68c196 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:33.376925 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-e952bb7d-8809-4008-8d86-35920f68c196 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] HTTP exception thrown: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e952bb7d-8809-4008-8d86-35920f68c196 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Request method failure captured: Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 HTTP/1.1 Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI33t9Ff3TC6CaCfsx0czw0aBn8SD971R6_ioWsuVVpNi0zF2ESYXoxIEUvDbAOOWHRzz6oHuCdf4_2RqqNhP9mQ77-EY60fPpMohdukHLgEyEJbXI4R1rkdi1l6pQ2kJrSca9C5Bbpsq4E43x0mAZRVDcBBcWGVxYLA04vtN3Vi6GMI Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 427b697da1034408811e994e22d4f592 Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:38:33.378511 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:38:33.380192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_427b697da1034408811e994e22d4f592", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/427b697da1034408811e994e22d4f592"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/427b697da1034408811e994e22d4f592"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/427b697da1034408811e994e22d4f592"}]}] Sep 15 19:38:33.380192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:33.380192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 427b697da1034408811e994e22d4f592 Sep 15 19:38:33.380192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:33.380192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeShelveTestJSON-357440265-project Sep 15 19:38:33.380192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:38:33.380192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:38:33.380192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 250673e17f40455ca2c5e0036f5a9e3c Sep 15 19:38:33.380192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeShelveTestJSON-357440265-project Sep 15 19:38:33.380192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:38:33.380192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:38:33.380192 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4'} Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:38:33.381005 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:38:33.382598 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:33.384429 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e952bb7d-8809-4008-8d86-35920f68c196 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Returning 404 to user: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:38:33.384429 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e952bb7d-8809-4008-8d86-35920f68c196 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 404 len: 111 microversion: 2.20 time: 0.035627 Sep 15 19:38:33.384429 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 807/1076] 10.222.0.18 () {60 vars in 1280 bytes} [Thu Sep 15 19:38:33 2022] DELETE /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 15 19:38:33.388111 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-178be17f-c193-4beb-bda1-c17f647a3178 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:33.388823 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-178be17f-c193-4beb-bda1-c17f647a3178 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] [instance: f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 19:38:33.394668 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-178be17f-c193-4beb-bda1-c17f647a3178 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:33.395145 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-178be17f-c193-4beb-bda1-c17f647a3178 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:33.395579 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-178be17f-c193-4beb-bda1-c17f647a3178 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:33.396295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-178be17f-c193-4beb-bda1-c17f647a3178 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Acquiring lock "25eb2376-64df-4345-a21d-3047a261cd80" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 19:38:33.396741 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-178be17f-c193-4beb-bda1-c17f647a3178 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 19:38:33.397158 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-178be17f-c193-4beb-bda1-c17f647a3178 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Lock "25eb2376-64df-4345-a21d-3047a261cd80" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 19:38:33.410557 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-178be17f-c193-4beb-bda1-c17f647a3178 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] HTTP exception thrown: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-178be17f-c193-4beb-bda1-c17f647a3178 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Request method failure captured: Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 HTTP/1.1 Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Connection: close Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Host: 10.222.0.18 Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjI33t9Ff3TC6CaCfsx0czw0aBn8SD971R6_ioWsuVVpNi0zF2ESYXoxIEUvDbAOOWHRzz6oHuCdf4_2RqqNhP9mQ77-EY60fPpMohdukHLgEyEJbXI4R1rkdi1l6pQ2kJrSca9C5Bbpsq4E43x0mAZRVDcBBcWGVxYLA04vtN3Vi6GMI Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Id: 427b697da1034408811e994e22d4f592 Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Role: member,reader Sep 15 19:38:33.412107 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Roles: member,reader Sep 15 19:38:33.413762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_427b697da1034408811e994e22d4f592", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/427b697da1034408811e994e22d4f592"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/427b697da1034408811e994e22d4f592"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/427b697da1034408811e994e22d4f592"}]}] Sep 15 19:38:33.413762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:33.413762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 427b697da1034408811e994e22d4f592 Sep 15 19:38:33.413762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-357440265 Sep 15 19:38:33.413762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeShelveTestJSON-357440265-project Sep 15 19:38:33.413762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 15 19:38:33.413762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 15 19:38:33.413762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Id: 250673e17f40455ca2c5e0036f5a9e3c Sep 15 19:38:33.413762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeShelveTestJSON-357440265-project Sep 15 19:38:33.413762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: method: > Sep 15 19:38:33.413762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: exception: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:38:33.413762 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: action_args: {'id': 'f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4'} Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 19:38:33.415028 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. Sep 15 19:38:33.416694 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 15 19:38:33.418745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-178be17f-c193-4beb-bda1-c17f647a3178 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] Returning 404 to user: Instance f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 19:38:33.418745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-178be17f-c193-4beb-bda1-c17f647a3178 tempest-AttachVolumeShelveTestJSON-357440265 tempest-AttachVolumeShelveTestJSON-357440265-project] 10.222.0.18 "GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4" status: 404 len: 111 microversion: 2.20 time: 0.028964 Sep 15 19:38:33.418745 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 808/1077] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 15 19:38:33 2022] GET /compute/v2.1/servers/f2aadc54-2cfd-47e7-85f0-9f23fb4b9fb4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 19:38:42.465084 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5192f14a-d3ac-4403-a264-cc31ced548ec tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] Calling method '.version_select at 0x7f5522404f70>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:42.513685 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5192f14a-d3ac-4403-a264-cc31ced548ec tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/41816170-b523-4e19-a437-6701e77d2a02" status: 200 len: 350 microversion: 2.1 time: 0.052524 Sep 15 19:38:42.514284 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 809/1078] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:38:42 2022] GET /compute/v2.1/os-volumes/41816170-b523-4e19-a437-6701e77d2a02 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:38:44.183799 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:38:44.184515 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:38:44.189293 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4e9d14e8-402d-465d-b21c-38abd6572649 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] Calling method '.version_select at 0x7f55224449d0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:44.236908 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4e9d14e8-402d-465d-b21c-38abd6572649 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/a36c1628-dfb8-4afd-bb37-71fb44ac5ade" status: 200 len: 351 microversion: 2.1 time: 0.053931 Sep 15 19:38:44.237519 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 810/1079] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:38:44 2022] GET /compute/v2.1/os-volumes/a36c1628-dfb8-4afd-bb37-71fb44ac5ade => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:38:45.928379 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c7877d65-7f21-4c1b-8a56-5e0d44df3311 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] Calling method '.version_select at 0x7f552244d4c0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:45.976667 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c7877d65-7f21-4c1b-8a56-5e0d44df3311 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/741f76b8-d0d2-46cd-83cc-fbd6965721fe" status: 200 len: 350 microversion: 2.1 time: 0.053137 Sep 15 19:38:45.977272 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 811/1080] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 15 19:38:45 2022] GET /compute/v2.1/os-volumes/741f76b8-d0d2-46cd-83cc-fbd6965721fe => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:38:45.991409 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0f4a1b4b-dd42-4b0d-bd29-a9ca7be92cd9 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] Calling method '.version_select at 0x7f551ec2adc0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:46.078012 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0f4a1b4b-dd42-4b0d-bd29-a9ca7be92cd9 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090737 Sep 15 19:38:46.078658 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 812/1081] 10.222.0.18 () {58 vars in 1134 bytes} [Thu Sep 15 19:38:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:38:46.093129 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cef35f4e-ce9d-4746-835a-16448d38f675 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] Calling method '.version_select at 0x7f551e9d7d30>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:46.190295 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cef35f4e-ce9d-4746-835a-16448d38f675 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.100957 Sep 15 19:38:46.190988 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 813/1082] 10.222.0.18 () {58 vars in 1149 bytes} [Thu Sep 15 19:38:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:38:46.205259 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7f6718ee-b61c-405d-ac47-d57bc12a6320 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] Calling method '.version_select at 0x7f552244ddc0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:46.290625 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7f6718ee-b61c-405d-ac47-d57bc12a6320 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.088994 Sep 15 19:38:46.291395 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 814/1083] 10.222.0.18 () {58 vars in 1134 bytes} [Thu Sep 15 19:38:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:38:46.304961 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-69e30d2b-de26-45aa-bf8b-cec5c87db3b4 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] Calling method '.version_select at 0x7f552247a8b0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:46.390082 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-69e30d2b-de26-45aa-bf8b-cec5c87db3b4 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088608 Sep 15 19:38:46.390655 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 815/1084] 10.222.0.18 () {58 vars in 1167 bytes} [Thu Sep 15 19:38:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:38:46.403981 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-40f67edb-4cb3-4a64-8abe-d06a3d6d39b5 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] Calling method '.version_select at 0x7f5522456a60>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:46.488221 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-40f67edb-4cb3-4a64-8abe-d06a3d6d39b5 tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087836 Sep 15 19:38:46.488789 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 816/1085] 10.222.0.18 () {58 vars in 1170 bytes} [Thu Sep 15 19:38:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:38:46.502400 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-df008a3e-dfbf-4a4c-b5f2-0a5ba72988bd tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] Calling method '.version_select at 0x7f55224443a0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:46.584951 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-df008a3e-dfbf-4a4c-b5f2-0a5ba72988bd tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086300 Sep 15 19:38:46.585534 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 817/1086] 10.222.0.18 () {58 vars in 1155 bytes} [Thu Sep 15 19:38:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:38:46.599275 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b31e4d50-2913-4913-8ee3-d79bd358536b tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] Calling method '.version_select at 0x7f551ec2a0d0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:46.680568 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b31e4d50-2913-4913-8ee3-d79bd358536b tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085531 Sep 15 19:38:46.681144 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 818/1087] 10.222.0.18 () {58 vars in 1188 bytes} [Thu Sep 15 19:38:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 19:38:46.694586 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ed91e0ee-ee6d-4016-baca-8e82810d2bdf tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] Calling method '.version_select at 0x7f5522404f70>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 19:38:46.782605 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ed91e0ee-ee6d-4016-baca-8e82810d2bdf tempest-VolumesTestJSON-22659069 tempest-VolumesTestJSON-22659069-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.091906 Sep 15 19:38:46.783177 dv-cinder-849846-10-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 819/1088] 10.222.0.18 () {58 vars in 1155 bytes} [Thu Sep 15 19:38:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 19:39:59.803840 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 19:39:59.804343 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Thu Sep 15 19:39:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Sep 15 19:40:20.626142 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 19:40:20.626880 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Thu Sep 15 19:40:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Sep 15 19:40:24.126755 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 19:40:24.127457 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Thu Sep 15 19:40:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Sep 15 19:43:19.816472 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 19:43:19.817190 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Thu Sep 15 19:43:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Sep 15 19:43:40.636699 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 19:43:40.637421 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Thu Sep 15 19:43:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Sep 15 19:43:44.137768 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 19:43:44.138432 dv-cinder-849846-10-iscsi devstack@n-api.service[121040]: Thu Sep 15 19:43:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!!